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FOREWORD 



It is generally assumed that the process of assessing educational attainment of students is a relatively recent 
phenomenon. This is not the case. Surprisingly, assessment has roots leading as far back as 2000 B.C. During 
the reign of the Shun Dynasty in Cliina, students spent years preparing to take the extensive series of tests 
leading to positions in civil service. In the Middle Ages, Jesuit monks developed an elaborate program to evaluate 
the educational progress of novices entering the order. 

The seeds of assessment in American education germinated in the 1860s. One of the first directives given 
to the U.S. Office of Education, founded in 1867, was 'Vo determine the progress of education." However, 
student a.ssessment was to play a minor role in public education until the turn of the century. 

Renewed interest in assessment in America came about as a result of the work of Simon and Binet who 
in 1905 were commissioned by the Paris Ministry of Public Instruction to "develop a test which could identify 
those children likely to fail in school, " It was planned that these children would be placed in special classes 
before losing too much ground or becoming discouraged. Simon and Binet's Metric Scale of Intelligence worked 
quite well and was quickly adapted to test public school children in the United States. In the period following 
the development of this scale other individual and group tests became available. 

These early tests had two traits in common. Initially, their express purpose was to select or weed out 
individuals rather than evaluate the progress of the total program offered to students. Further, the vast majority 
of tests concerned themselves solely with those skills in the cognitive domain, such as the 3 R*s. 

These tests proved fairly satisfactory because they were tied to a very narrow conceptualization of the 
school's role in society, namely, the imparting of knowledge associated with the traditional academic disciplines. 
As society developed broader expectations of the school in regard to its responsibilities for educating the "whole 
child," an increasing emphasis was placed on the affective development of students-their social and emotional 
growth. 

Changing beliefs concerning what schools are all about, increasing sophistication in computer technology 
and society's increasing demand to evaluate school programs have led to a proliferation of wide-scale assessment 
programs. 

Pennsylvania's Educational Quality Assessment program is one of these. Assessing affective as well as cognitive 
growth of students, it represents an attempt to give Commonwealth schools valid and reliable information 
concerning the effectiveness of their overall educational programs and to identify areas in which additional 
programs would be fruitful. 



ERIC 



iii 



TABLE OF CONTENTS 



Introduction v 

Section One: History and Development 1 

Section Two: Rationale and Measurement 5 

Goal 1 7 

Goal 11 13 

Goal III 19 

Goal IV 24 

Goal V 28 

Goal VI , 35 

Goal VII 41 

Goal VIII 48 

Goal IX 52 

Goal X 57 

Section Three: Target Groups for Program Focus 63 

Section Four: Relationships among Scales > 73 

Appendix 82 



ERLC 



iv 



INTRODUCTION 



The Intermediate Form of the Educational Quality Assessment Inventory (EQAI) for grades 7 and 9 is 
designed to provide Commonwealth schools with meaningful and reliable information about student development 
in each of the 10 state adopted quality education goals. The EQAI can be characterized as a collection of 
structured, paper-and-pencil measurement devices purporting to appraise those diverse psychological constructs 
such as attitudes, values, beliefs, habits and basic cognitive skills thought to be important in becoming a 
well-rounded, functioning young citizen in today*s world. 

Clearly, paper-and-pencil devices represent an efficient and economic method for providing information 
concerning student attitudes and skills. However, results gleaned from these measures are subject to many and 
varied misinterpretations. 

To make maximum use of the information offered by the EQAI one must know where the tests come 
from, what they really measure, how accurately and reliably they measure it, what scores on the tests mean, 
how acceptable scores are determined and how much influence faking and response bias have on the final results. 

This manual, organized in four sections, gives insight into these and other technical properties of the EQAI 
scales. The first section highlights the procedures and techniques used to construct and field-test the assessment 
instruments and gives an overview of the total inventory. Section two discusses the 10 quality education goals 
and the measurement devices associated with each. Included in this section are the goal and measurement 
rationales, scale and subscale descriptions, scoring procedures employed, and reliability and validity findings for 
each instrument. Section three offers a series of tables which isolate specific student target groups that might 
benefit the most from programs designed to facilitate growth in each goal area. Section four discusses additional 
properties of the battery and summarizes the interrelationship between all scales and subscales. The technical 
and statistical terms used in this manual are defined in the Appendix. 
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SECTION ONE 
History and Development 



Attitudes and Their Measurement 

Attitudes, beliefs, values, etc., are 
abstractions-nevertheless they are real enough to the 
individual who holds them. They are typically thought 
of as a state of readiness, a predisposition to act or 
react in a certain way when faced with certain 
situations. Thus the person's attitudes are present but 
dormant most of the time. They are expressed in speech 
or other behavior only when the object of the attitude 
is perceived. A person may have strong attitudes for 
or against astrology but they are actively expressed only 
when some issue connected with astrology arises - or 
when confronted by an attitude scale! Attitudes are 
often reinforced by beliefs (the cognitive component) 
and attract strong feel: igs (the emotional component) 
that will lead to particular behaviors (the action 
tendency component). 

The measurement of attitudes always involves 
making inferences. Since the attitudes cannot be seen 
or measured directly, we must infer their presence from 
consistencies that appear in the individuaPs behavior. 
Observing individuals across time in everyday situations 
is probably the best way to get a handle on how the 
individual thinks, feels and acts. 

Clearly, this method is much too cumbersome and 
costly when we want to investigate the intensity and 
direction of attitudes for a large number of people, 
forcing us to rely instead on verbal reports of the 
individuals concerned. 

Testing the Tests 

The use of paper-and-pencil scales requires several 
assumptions: (a) individuals will respond with 



consistency to questions that are asked and will state 
fairly stable preferences that reveal underlying attitudes, 
(b) they will refrain from deliberately choosing 
responses so as to make themselves look good and 
answer as honestly as possible and (c) the questions 
themselves will be realistic in terms of the attitude of 
concern. 

In order to insure that the scales included in the 
EQAI meet the above assumptions as closely as possible, 
each scale is taken through an extensive series of field 
trials and revisions. This philosophy of "testing the tests 
before using them to test people" resulted in a 
three-year developmental period requiring strong 
cooperation between the Department of Education and 
over 100 Commonwealth school districts. 

After completing the tasks of operationally 
defining each goal area to be measured, developing 
measurement rationales consistent with these 
definitions, and constructing pools of items to be 
included in each scale, the instruments were organized 
into a large experimental battery. 



Phase I Field Trial 

During October 1971 this battery was field-tested 
using approximately 2,800 7th grade students drawn 
from 91 schools. Located at each testing site was a 
monitor who had been trained by department personnel 
to control testing procedures and to record student 
reactions to each scale in special log booklets. A sample 
log is presented below. 



EXAMPLE 



MONITOR'S LOG: 



TIME: 

Section Started 80% had completed Section Terminated 

DESCRIPTION OF SECTION 





Poor 


Adequate 


Good 




1 


2 3. 


4 


DIRECTIONS 


() 


( ) ( ) 


( ) 


ITEM SENTENCE STRUCTURE 


() 


( ) ( ) 


( ) 


VOCABULARY LEVEL 


() 


( ) ( ) 


( ) 


TIME ALLOWED 


() 


( ) ( ) 


( ) 



DESCRIPTION OF STUDENTS 





1 


2 3 


4 




BORED 


() 


( ) ( ) 


( ) 


EAGER 


CONFUSED 


( ) 


( ) ( ) 


( ) 


CLEAR 


CARELESS 


() 


( ) ( ) 


( ) 


CAREFUL 


DISTRACTED 


() 


( ) ( ) 


( ) 


CONCENTRATING 



If answer is yes to any of below questions: explain on back of this sheet. 

1) Were you forced to deviate from directions? (Y) (N) 

2) Did students have difficulty marking answer sheet properly? (Y) (N) 

3) Were there any words students had major difficulty understanding? 

(If yes, circle words and items in Questionnaire) (Y) (N) 

List number of each student whose performance might invalidate his or her score on this section. Reasons 
include student (a) staring into space and not completing section, (b) copying answers and (c) marking answers 
without referring to questionnaire booklet. 

NUMBER REASON 

I. 
2 
3. 
4. 
5. 
6. 
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These "Monitor Logs"wQTC designed to evaluate 
the following specific properties of tiic experimental 
measuring devices. 

The understandability of directic)ns and task 
requirements aiisocia^ed with each scale. 

The difficulty of vocabulary and/or phrases 
used in each item. 

The perceived relevance of response choices 
for each item and scale. 

Analysis of monitor-reported student reactions led 
to major changes jn approximately one-third of the 
scales and minor changes in all Che scales. In addition, 
the logs were used to answer the following questions 
associated with the total-test battery. 

How quickly do students get bored and 
become careless during the testing period? 

Is there a relationship between scale scores 
and the emotional climate expressed by the 
group when completing the scales? 

Is there a relationship between scale scores 
and testing conditions (i.e. lighting, 
distractions, etc.)? 

An index of emotional climate was constructed by 
adding scores on the bipolar student description check 
list (see "Monitor's Log'*- Description of Students). 
Analysis of these scores revealed a statistically 
significant decrement in the first session. At the outset 
of the second session, the emotional climate was at a 
level comparable to what it was in the beginning of 
the first session. However, it again showed a significant 
decline across the second session. 

Scores on scales given during the latter half of eiich 
session were correlated with emotional climate. 
Although all correlations were slightly positive, none 
was statistically significant. 

Finally, 30 school groups who had experienced 
some adverse testing conditions in terms of settings, 
distraction, etc., were compared to the remaining 61 
groups who experienced little or no adversity on each 
of the scales with the use of independent t-tests. While 
the majority of comparisons gave slight advantages (in 
terms of obtained scores) to the no adversity group, 
none of the comparisons resulted in statistically 



significant I's. These results led to the c^ >clusion that 
when testing conditions arc fairly well controlled by 
trained monitors, the scales were not highly influenced 
by emotional climate and testing conditions. 

Concurrent with scale evaluations using data 
gathered from test monitors, various statistical analyses 
were performed on data gathered from the 2,800 
students in order to answer these questions: 

How unidimensional or homogeneous is the 
group of items comprising each scale, i.e., do 
items witliin the scale hang together? 

Which items within each scale discriminate 
best between students and groups of 
students? 

How do items/scales within the battery relate 
to one another? 

A Likert-type item-analysis was conducted for each 
scale. This technique incorporates correlating scores on 
each item with the total score of the instrument after 
removing that particular item's contribution to the total 
score. Then, after isolating the top and bottom 27 per 
cent of the scores on the total test, t-tests are performed 
between the two groups on each item within the scale. 
By examining the results of these two procedures one 
can determine the degree of interrelationship between 
each iten and the total scale score while at the same 
time identify those items which most efficiently 
separate the high and low scoring groups. Two such 
analyses were performed on data from each instrument 
- one using individuals as units of analysis and one using 
group scores as units of analysis. 

Those items failing to correlate with the total 
scores (r < .25) and/or failing to discriminate between 
the high and low groups (t c 1 .96) were removed from 
the scale or revised. 

Also computed for each measurement device was 
the coefficient alpha, an index of internal consistency 
reliability. This index takes into account the number 
of items within the scale and the average 
intercorrelation of the items. Ranging in value from 
0.00 through 1. 00, this index describes the proportion 
of "true" variance within the test as opposed to "error" 
variance. Tho reliability and item-analysis results led to 
revisions in every scale and removal of two scales from 
the battery. 
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A final analysis was conducted to determine 
whether the tendency of students to make socially 
desirable answers was related to obtaining higher scores 
on any of the scales. Inserted into the battery was a 
special 36-item scale containing questions such as "/ 
fuive never been angry at anybody*' and 'Wo matter 
who I'm talking to, l*m always a good listener, ** This 
scale was designed to measure the tendency to make 
socially desirable responses. Scores on this instrument 
were correlated with scores on all other items and 
instruments Those items and scales whose scores were 
found to be associated with socially desirable 
respondmg were deleted or revised to minimize the 
relationships found. 

Developing Subscales 

Instrument revision and new scale development 
were completed by April 1972. At this juncture efforts 
were directed at organizing the items to produce 
meaningful and reliable subscales for each instrument. 

In May 1972 short test booklets were constructed 
which contained three or four instruments. Each 
booklet was administered to approximately 300 9th 
grade students drawn equally from rural, suburban and 
inner-city settings. Analytic procedures similar to those 
used on 7th grade data were again employed. In 
addition, efforts were made to evaluate the technical 
characteristics of each subscale. 

Because item assignments to subscales were made 
on a rational basis, i.e. by grouping items according to 
their face content, it was necessary to develop empirical 
criteria for item placement into subscales. 

The criterion regarding items was: For an item to 
remain in the subscale it must correlate more highly 
with its particular subscale score (its contribution to 
the subscale score having been removed) than with any 
other subscale or total scale score. 

The subscales themselves had to meet two criteria 
before being finalized. First, the intercorrelations 
between subscale scores could not exceed 70. This 
criterion was developed to insure that information 
provided by the subscales would not be redundant to 
the information provided by the total scale scores. 

Second, the internal consistency reliability for each 
subscale had to be greater than .60. This criterion 
provided another safeguard that tlie subscales were 



homogeneous. 

When a subscale did not meet these criteria, the 
subscale was deleted and its Items were either reassigned 
to the remaining subscales or deleted. The revised 
subscales were again subjected to all of the above 
criteria. This process was continued until all items and 
subscales met the criteria. 



Scoring of the Scales and Subscales 

In order to give school personnel a clearer picture 
about the performance of their students on the EQAI, 
two scoring methods were developed for each attitude 
scale. The first scoring method organizes the response 
options within each scale into a hierarchy. Different 
scoring weights are then applied to each level of the 
hierarchy. Consequently, for an item such as 7 like 
school** with response options (a) strongly disagree, (b) 
disagree, (c) agree and (d) strongly agree, weights of 
one through four are applied respectively to each answer 
choice. This method is based on the assumption that 
'^strongly agreeing** with a statement is more positive 
than merely *'agreeing*' with the statement. 

Item scores obtained by this method are summed 
and used to generate norm-referenced information 
about student performance. How well a group of 
students perform on the scales is determined by the 
relationship of their scores to other student groups. This 
**norm'perfcrmance** tells us little about how favorable 
or unfavorable the student scores are. 

To obtain information about favorable and 
unfavorable responding, a criterion-referenced scheme is 
used. This scoring method is based on the notion that 
each item within the scale offers the respondent the 
chance to show a positive or negative attitude toward 
the specific content presented by the scale item. Hence, 
the response choice to the above item is scored by 
assigning a one to the **strongly agree'* and **agree** 
choices and a zero to the remaining choices. 

The number of positive responses given by each 
student is obtained. This count is compared to an 
independently determined **standard** oi ''criterion. *' \{ 
the number of favorable responses meets or exceeds the 
standard, the student is said to have '*achieved" the 
standard. In the case of scales used in the EQAI, three 
criteria were set. The first, required students to respond 
favorably to more than 35 per cent of the items; the 
second, required favorable responses to more than SO 
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per cent of the items and the third required favorable to give some indication of their construct validity. Tltese 
responses to more than 70 per cent of the items. results are reported in Section Four of this manual. 



Validity 

Validity has typically been defined as the quality 
of measurement which answers questions relating to the 
degree the test measures what it is intended to measure 
and nothing else. Various types of validity include: 

/. Content validity - Can informed readers agree 
that the test content is appropriate for the 
construct the test purports to measure? 

2. Criterion validity - Can scores on the test 
predict what students will do outside the 
testing situation or discriminate between two 
or more groups of students who are known 
to have different characteristics? 

3. Construct validity - Are the test scores related 
with other variables in predictable ways? 

All EQAI scales have content validity. Their 
contents were **validat€d** according to the rationales 
developed for each of the 10 goals of EQA staff 
members, measurement researchers and school 
personnel. Several of the EQAI scales were subjected 
to criterion related validity studies. Descriptions of 
these studies are included in Section Two. The subscales 
and composite scales v/ere subjected to a factor analysis 



Overview of the EQAI 

The EQAI contains 458 items comprising 14 
composite scales. Twelve instruments are directly 
related to measurement of students* achievement in the 
10 quality education goal areas. The remaining two are 
special scales designed to measure students* perception 
of (a) the atmosphere of home life (Home Climate) and 
(b) their tendency to respond to items in a manner 
which will place them in a favorable light (Social 
DesirabUity). 

The EQAI is specifically designed for assessment 
at grades 7 and 9. Identical scales are used for each 
of these grade levels except for the basic skills area, 
i.e. math and verbal skills. 

The normative base for the EQAI was formed by 
statewide testing in March 1973. The normative group 
for grade 7 included approximately 15,000 7th grade 
students who were eruoUed in 62 Commonwealth 
middle schools (5-8, 6-8, 5-7 buildings with approved 
programs as of October 1971). The 9th grade sample 
included about 25«000 9th grade students who were 
enrolled in 114 Commonwealth schools having a grade 
structure of 7-9 or 7-12. For further clarification 
regarding the normative sample see "Manual for 
Interpreting Intermediate School Reports, " 
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SECTION TWO 
Rationale and Measurement 



This section discusses each of the 10 quality 
education goals and the measurement rationales used 
to assess specific components of each goal and describes 
in detail each of the goal related scales. Information 
is also presented on technical properties of each scale. 
Brief definitions of the technical terms used in this 
section can be found in the Appendix. 

The statistical characteristics shown for each scale 
are based upon analyses using two subsamples of 
individual student data gathered from the 1973 
normative samples. The subsamples were derived by 
randomly selecting one-fifth of the 7th grade students 
tested and one-seventh of the 9th grade students tested. 

The 7th grade student suhsample is comprised of 
2,886 students - 25 per cent coming from rural homes, 
26 per cent from homes in small towns (less than 
10,000 people), 43 per cent from suburban homes and 
about 6 per cent from urban homes. 



About 49 per cent are girls, 93 per cent are white, 
3 per cent are black and 4 per cent are other races. 
About 26 per cent of the 7th grade students report 
having moved in the past three years. 



The grade 9 subsample has 3,018 students, h 
contains 18 per cent rural students, 32 per cent from 
small towns, 29 per cent living in suburban and 21 per 
cent living in urban areas. Of the urban group, however, 
less than 1 per cent live inside a city of more than 
100,000 people. 



The grade 9 subsample splits exactly 50-50 on sex. 
Fo' i per cent of the grade 9 sample are black, 92 per 
cent are white and 4 ptr cent are other races. Sixteen 
per cent of the 9th grade students report having moved 
in the past three years. 
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GOAL I: SELF-ESTEEM 



Goal Statement 

Quality education should help every child 
acquire the greatest possible understanding of 
himself and an appreciation of his worthiness 
as a member of society. 

Goal Rationale 

It is widely held that self-understanding is 
significantly associated with personal satisfaction and 
with effective functioning. The views which students 
have of their adequacies and their inadequacies and of 
their values and their desires can strongly influence their 
performance in school. 

Regardless of the level and pattern of each 
student's particular talents, the school experience 
should strengthen, not damage, each child's self-esteem. 
The school should be operated in such a way that 
children at all levels of talent can achieve a growing 
awareness of their worth as persons in a society that 
claims to have an equality of concern for all its 
members. 

Measurement Rationale 

Self-esteem is a personal judgment of worthiness, 
a subjective experience which the individual conveys to 
others by verbal reports and other overt expressive 
behaviors. Most theories acknowledge the fact that our 
self-image and feelings of worthiness are determined to 
a large extent by the degree to which we are able to 
live up to our own aspirations and to meet certain 
expectations held by others. 

Viewed in this way aspirations become closely 
associated with personal goal setting behavior 
originating in our internalized system of values, while 
expectations are external in nature and are related to 
goals set collectively by society or by significant 
individuals in our lives. Assessment in this area is based 
on four constructs believed to be related to the 
development of positive self-esteem. 

The first has to do with locus of control - whether 
one views personal success as dependent upon one's own 
efforts or due to external inf iences. Externally 
controlled individuals will tend to be more dependent 
on others and be more willing to ride with the tide. 



accepting docilely, things which happen to them. 
Internal individuals will be more active in attempting 
to control self-destiny. 

The second related concept is self-confidence - the 
feeling of self-worth and the belief that one is capable 
of handling things successfully. Those who lack 
self-confidence are often characterized as being timid, 
cautious, submissive individuals who feel inadequate, 
fearful, inferior and expect to be unsuccessful in dealing 
with new situations. 

The third concept is image in school settings. 
Those having favorable self-images are likely to 
experience subjective success v^th schoolwork, feel that 
they are favorably viewed and understood by teachers 
and enjoy class participation. 

The final dimension involves the students'views of 
the quality of their relationships with others. Individuals 
who have difficulty in interpersonal relations will tend 
to hold the belief that others have little confidence in 
them or hold them in low regard. 

General Scale Description* 

The self-esteem scale is comprised of 36 short, 
self-description statements. Ten are positively worded 
- describing the student in a favorable light and 26 are 
negatively worded — characterizing the student in a 
negative vein. 

Sample positively worded item: easy to get 
along with. " 

Sample negatively worded item: "Tilings are all 
mixed up in my life. " Response options available to 
the students are: (1) very much like me, (2) usually 
like me, (3) usually unlike me and (4) very much unlike 
me. 

The items within the scale are grouped in such a 
way as to yield four subscale scores in addition to a 
total scale score. 

Subscale 1 : 

Self-confidence contains 10 items measuring 
feelings of success, self-determination, 
attractiveness and self-worth. Sample item: "I'm 
pretty sure of myself " 



♦The self-esteem scale is a result of extensive revision of the Goal 1 instrument which was used for grades 
5 and II. Richard L. Kohr and Nolan F. Russell from the Division of Educational Quality Assessment were 
responsible for the revisions. 
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Subscalc 2 



Feelings of control over environment contains eight 
items tapping belief that success in school and 
work depend on effort, not luck* Sample item: 
"Afy getting good grades in school depends more 
on how the teacher feels about me than on liow 
well I can do my work, " 



Subscale 3 



Relationships with others contains eight items 
assessing the student's perceived ease in making 
and keeping friends and the student's feelings of 
acceptance by others. Sample item: "I often feel 
picked on by oi her kids. " 



Subscale 4 



Self-image in school comprises 10 items designed 
to measure feelings of success in school work, class 
recitation and teacher relationships. Sample item: 
"In class. I often feel 'put down ' by teachers. " 



Norm.Referenced Scoring 

For norm-referenced scoring the item weighting 
scheme used is. 

Response Options 
Item Very Much Usually Usually Very Much 
Direction Like Me Like Me Unlike Me Unlike Me 

Plus 3 2 10 

Minus 0 12 3 

Criterion-Referenced Scoring 

Responses are considered "favorable" if they 
reflect a positive self-image. An individual's score on 
a given scale (total or subscale) is the percentage of 



items to which a favorable response was given. For the 

self-esteem instrument the scoring scheme applied to the 

items is: „ ^, , 

Response Choices 



Item 

Direction 

Plus 

Minus 



Very Much 
Like Me 



Usually UsuaDy Very Much 
Like Me Unlike Me Unlike Me 



1 



Each student's score is then compared to a 
standard having three levels. To meet level one the 
student must respond favorably to at least 35 per cent 
of the items. To meet level two the student must 
respond favorably to at least 51 per cent of the items. 
Level three requires students to choose favorable 
response choices to at least 70 per cent of the items. 



Technical Properties 

The self-esteem scale has a reading difficulty level 
of grade 4.9 (based on Gunning - Fog Readability 
Formula). Reliability estimates were obtained separately 
for low achievement, average achievement and high 
achievement students (defined by scores on composite 
math-verbal scale), in order to determine its 
appropriateness for students of differing reading 
abilities. The resulting coefficient alphas across the three 
groups in grade 7 were .79, .87 and .90. At grade 9 
they were found to be .82, .88 and .90. 

Selected norm-referenced characteristics of the 
instrument based on the total grade 7 subsample are 
presented in Table 1 . Table 2 gives the same information 
relative to the grade 9 subsample. Tables 3 and 4 show 
the intercorrelations between subscales at each grade. 
Table 5 gives the reliability estimates obtained through 
criterion-referenced scoring and shows the proportion 
of students meeting each criterion level. 
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TABLE 3 



CORRELATION MATRIX BETWEEN SUBSCALES 
FOR SELF-ESTEEM SCALE: GRADE 7 



SUBSCALE NAME 



Subscale Name 



Self- 
Confide nee 



Control over 
Environment 



Relationships 
with Others 



Control over 
Environment 



.52 



Relationships 
with Others 



.51 



.37 



Self -Image 
in School 



.53 



.51 



.40 



TABLE 4 

CORRELATION MATRIX BETWEEN SUBSCALES 
FOR SELF-ESTEEM SCALE: GRADE 9 



SUBSCALE NAME 



Subscale Name 



Self- 
Confidence 



Control over 
Environment 



Relationships 
with Others 



Control over 
Environment 



.50 



Relationships 
with Others 



.54 



.35 



Self-Image 
in School 



.54 



.48 



.45 
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GOAL II: UNDERSTANDING OTHERS 



Goal Statement 

Quality education should help every child acquire 
understanding and appreciation of persons 
belonging to social, cultural and ethnic groups 
different from his own. 

Goal Rationale 

The students fulfilling Uie requirements of Goal 
n will more likely enjoy an easy interaction with all 
people - speaking to and selecting as friends students 
of different origins and beliefs. They will be more 
willing to actively seek information or participation in 
activities which will increase their knowledge about 
other cultures and social settings. 

The school experiences should help students learn 
to respect and achieve an easy interaction with children 
who differ from them in various aspects (e.g., skin color, 
cultural traditions, economic status, religious beliefs, 
physical abilities, manner of speech and degree of 
intellectual competence). 

Measurement Rationale 

The processes and determinants of interpersonal 
interaction are complex, involving a myriad of 
perceptual, feeling and behavior responses. 

The notion of tolerance toward others has meant 
a variety of things to various theorists. Some define 
tolerance in terms of the '^social distance" individuals 
keep between themselves and differing others. Others 
use tolerance to describe the tendency of individuals 
to make stereotypical prejudgment or to take actions 
toward differing others based solely on the differing 
others' group membership. 

The assessment of this goal area is based on still 
another component of tolerance. This component is the 
degree of comfort experienced by individuals when 
finding themselves in contact with differing others. 

General Scale Description* 

Items describe situations where differing others 
interact with the individual. Differences are in terms 



of racial, religious and social background or physical 
and mental attributes. Twenty-four items suggest an 
approach toward the student, e.g., "A cripple wants you 
to become a close friend. " Nine items suggest an 
avoidance of the student, e.g.,"i4 girl with a bad limp 
avoids you because she thinks you might make fun of 
her." Response choices are "/ would feel" (1) very 
uncomfortable, (2)uncomfortable, (3) comfortable and 
(4) very comfortable. 

The items within the scale are grouped In such a 
way as to yield five subscale scores in addition to a 
total scale score. Assignment to subscales is based upon 
the characteiistic of the hypothetical target person that 
makes the target person "different " from the 
respondent. The five subscales are race, religion, 
socioeconomic status, intelligence and handicap. The 
religion and handicap subscales each contain six items 
while the remaining subscales contain seven items 
apiece. 

Norm-Referenced Scoring 

For norm-referenced scoring, the item weighting 
scheme is: 

Response Options 

Item Very Comfort- Uncomfort- Very Uncom- 
Direction Comfortable able able for table 

Plus 3 2 1 0 

Minus 0 12 3 



Criterion-Referenced Scoring 

Responses are considered "favorable" if they 
reflect comfort when interacting with differing others 
or discomfort when being shunned by differing others. 
An individual's score on a given scale (total or subscale) 
is the percentage of items to which a favorable response 
was given. For the tolerance toward others instrument 
the scoring scheme for items is: 



*The tolerance toward others instrument was developed by Eugene W. Skiffington and Nolan F. Russell from 
the Division of Educational Quality Assessment and Peggy L. Stank and Tom McGinnis from the Division of 
Research. 
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Response Choices 

Item Very Com- Comfort- Uncom- Very Uncom- 
Dir. fortable able fortable fortable 

Plus 1 1 0 0 

Minus 0 0 II 

Each student's score is then compared to a 
standard having three levels. To meet level one the 
student must respond favorably to more than 35 per 
cent of the items. To meet level two the student must 
respond favorably to more than 51 per cent of the 
items. Level three requires students to choose favorable 
response choices to more than 70 per cent of the items. 

Technical Properties 

The tolerance toward others scale has a reading 
difficulty level of grade 5.0. To obtain a clearer picture 
about the appropriateness of the total scale across 
students differing in ability, both the grade 7 and 9 
subsamples were split into three smaller groups (low 
achievement, average achievement and high 
achievement). Internal consistency reliability estimates 
across these groups were found to be .71, .81 and .86 
at grade 7 and .80, .84 and .87 at grade 9. 



Tables 6 and 7 list selected scale characteristics 
based on the total student subsamples. Note that the 
subscales socioeconomic status and intelligence show 
low reliabilities at both grade levels. Caution is suggested 
when interpreting scores on these two subscales. Tables 
8 and 9 show the intercorrelations between subscales. 
Table 10 gives the reliability estimates obtained tlirough 
criterion-referenced scoring and shows the proportion 
of students meeting each criterion level. 

Validity 

In an independent study a longer version of this 
instrument discriminated between those 7th grade 
students choosing others different from themselves in 
racial characteristics as friends from those students 
refusing to do so. 

Another indication of this scale's validity comes 
from the March 1973 test results. One school district 
which participated in the assessment had a recent 
history of racial tension causing schools to close on 
several occasions. Only 46 per cent of their grade 9 
population exceeded the criterion of making favorable 
responses to more than one-half of the items contained 
in the race subscale. Of the 25,000 grade 9 students 
tested across the Commonwealth, 73 per cent met this 
particular criterion. 
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TABLE 8 



CORRELATION MATRIX BETWEEN SUBSCALES FOR 
TOLERANCE TOWARD OTHERS SCALE: GRADE 7 



SUBSCALE NAME 
Socioeconomic 



SUBSCALE NAME 


Race 


Religion 


Status 


Intelligence 


Religion 


.40 








Socioeconomic 
Status 


.41 


.38 






Intelligence 


.36 


.29 


.41 




Handicap 


.43 


.31 


.49 ' 


.49 






TABLE 9 






CORRELATION MATRIX 
TOLERANCE TOWARD 


BETWEEN SUBSCALES FOR 
OTHERS SCALE: GRADE 9 










SUBSCALE NAME 




SUBSCALE NAME 


Race 


Religion 


Socioeconomic 
Status 


Intelligence 


Religion 


.45 








Socioeconomic 
Status 


.49 


.41 






Intelligence 


.40 


.30 


.49 




Handicap 


.46 


.35 


.49 


.53 
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GOAL III: BASIC SKILLS 



Goal Sutement 

Qmlitv education should help every child acquire 
to the fullest extent possible for him mastery of 
the basic skills in the use of words and numbers. 

Godt Rationale 

Mastery of the basic skills in the use of words and 
numbers is fundamental to achievement in all academic 
areas. Basic skills include the ability to acquire ideas 
tlirough reading and listening, the ability to handle 
mathcmuiical operations and the ability to reason 
iogicaily and to respect evidence. The level of 
perf«:»rmance that can be reasonably expected in each 
of these areas will vary from school to school. However, 
it is of profound importance that the level of 
expectation in basic skills for any group of pupils shall 
not be underestimated or regarded as fixed. 

Measurement Rationale 

In 1969 when Pennsylvania's Educational Quality 
Assessment program centered on 5th and 11th grade 
students, schools had the option of selecting either of 
two standardized achievement batteries for 
measurement in this goal area. It quickly became 
apparent that the use of these tests increased the length 
of the testing time to such an extent as to cause great 
difficulty in scheduling and completing the entire 
battery. 

Therefore, the use of achievement batteries was 
discontinued and shorter verbal and math scales 
developed by Educational Testing Service which were 
group reliable were substituted. 

In the verbal area assessment was directed at the 
ability to abstract or generalize and to think 
constructively, rather than at simple fluency or 
vocabulary recognition. The item type thought most 
appropriate was one using verbal analogies. 



General Scale Description (Verbal) 

The grade 7 and 9 verbal scales' each contain 30 
verbal analogies presented in a multiple-choice format. 
Each scale is timed (IS minutes). The scales are scored 
by giving one point for nach correct answer. No 
adjustment is made for guessing. 

Sample Grade 7 item: 

SHOE: FOOT:: 

A muffler scarf 

B sleeve ' coat 

C cuff : leg 

♦D glove : hand 

Sample grade 9 item: 

TERMITE: BUILDING:: 

A ant • hive 
B spider : fly 
C weed : garden 
*D worm : apple 

General Scale Description (Math) 

Both the grade 7 and 9 math scales^ are 30-item 
timed tests (15 minutes). Their ability to discern 
specific strengths and weaknesses in math-related areas 
is limited. However, they are considered to be a good 
measure for the general level of math achievement on 
a group basis. Modern math concepts (set notion, 
modular arithemetic, etc.) and advanced concepts such 
as trigonometry, logic and geometric proofs are not 
included. Areas tapped are arithmetic computation, 
algebraic and geometric concepts and measurement. A 
multiple-choice format is used for these scales. Each 
item requires students to make a size comparison 
between two quantities. The scales are scored by 
assigning one point to each correct answer. No 
adjustment is made for guessing. 

Sample grade 7 item. 
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The test in the math area is directed at those Column A 



mathematics skills and concepts all students should be 
familiar with and not skills and concepts attainable only 
by gifted children. Separate math and verbal scales were 
utilized for each grade level (grades 7 and 9). 



^Copyright (c) 1971, Educational Testing Service 
^Copyright (c) 1972, Educational Testing Service 



5 feet, 8 inches 



Column B 



58 inches 



*A The part in Column A is greater. 

B The part in Column B is greater. 

C The two parts are equal. 

D Not enough information is given to decide. 
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Sample grade 9 item: 

Column A Column B 

(6 X 8) + (4 X 8) 10 X 8 

A The part in Column A is greater. 

B The part in Column B is greater. 

*C The two parts are equal. 

D Not enough information is given to decide. 



♦Indicates correct answer 
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GOAL IV: INTEREST IN SCHOOL AND LEARNING 



Goal Statement 

Quality education should help every child acquire 
a positive attitude toward school and toward the 
learning process. 

Goal Rationale 

The school represents perhaps the most powerful 
single force in determining a person's overall attitude 
toward learning. In this regard, the climate and learning 
atmosphere present in the school, the nature of the 
educational experiences the school provides and the 
quality of the personal interactions it fosters between 
student and educator, all significantly shape the 
students* life-long attitudes toward learning. 

The school experience should be such that students 
find the learning activities associated with it enjoyable 
and rewarding to the point that they are motivated to 
do well and to continue learning on their own initiative 
beyond the requirements of formal education. 
Everything possible should be done to ensure that the 
attitude of the teacher, the atmosphere of the school, 
and the school's physical condition contribute toward 
this end so that the individual, both as a child and later 
as an adult, will hold education high among his or her 
values. 



Measure.nent Rationale 

In assessing student feehngs about education, it is 
necessary not only to examine those feelings within the 
context of the students' present school experience but 
also to make some determination regarding the ways 
this experience is influencing the students' general 
future attitude toward learning beyond the formal 
educational setting. The measurement, device developed 
in support of this goal attempts to sample student 
attitudes in two areas: The first, relates specifically to 
the present school experience and the second focuses 
on learning in its broader context as a long-range, 
life-time process. 

General Scale Description* 

In this scale there are 30 statements about the 
school, teachers, course content and the learning 



experience. Fifteen items cast these areas in a favorable 
light, e.g., "Most of my subjects this year are 
worthwhile, " The remaining items are negatively stated, 
e.g., ^'Teachers don't know what they are talking 
about. " Response options available to the student are 
(1) strongly agree, (2) agree, (3) uncertain, (4) disagree, 
(5) strongly disagree. 

The items within the scale are grouped into two 
subscales each having IS items. 

Subscale 1: 

Attitude toward learning measures the student's 
willingness to expand effort to learn and the value 
of continued learning throughout life. Sample 
item: "It is very important to me to learn as much 
as I possibly can, " 

Subscale 2: 

Attitude toward school investigates the degree to 
which the student believes school attendance is 
important and the student's attitude toward the 
school setting, teachers and course work. Sample 
item: "Most of my classes this year are boring. " 

Norm-Referenced Scoring 

For norm-referenced scoring, the following weigh- 
ing scheme is used:i 

Response Optioas 

Item Strongly Strongly 
Dir. Agree Agree Uncertain Disagre e Disagree 

Plus 4 3 2 1 0 

Minus 0 12 3 4 



Criterion-Referenced Scoring 

Responses are considered favorable if they reflect 
student agreement with positive s^tements about school 
and learning or disagreement with negative statements 
concerning school and learning. A student's score on 
a given scale (total or subscale) is the percentage of 
items to which a favorable response was given. For this 
scale the scoring scheme applied to the items is: 
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*The interest in school and learning scale is a result of extensive revisions of the Goal IV instrument which 
was used for grades 5 and 11. George E. Brehman from the Division of Research and Nolan F. Russell from 
the Division of Educational Quality Assessment were responsible for the revisions. 
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Response Choices 

Item Strongly Strongly 
Dir. Agree Agree Uncertain Disagree Disagree 

Plus 1 1 0 0 0 

Minus 0 0 0 1 1 



Each student *s score is then compared to a 
standard having three levels. To meet level one the 
student must respond favorably to more than 35 per 
cent of the items. To meet level two the student must 
respond favorably to more than 51 per cent of the 
items. Level three requires students to choose favorable 
response choices to more than 70 per cent of the items. 

Technical Properties 

The interest in school and learning scale has a 
reading difficulty level of 4.6. Reliability estimates were 
obtained separately for low, average and high achiever 



groups at both grades. Coefficient alphas were found 
to be .91, .90 and .88 at grade 7 and .89» .88 and 
.84 at grade 9. 

Tables 13 and 14 list selected scale characteristics 
derived from the total grade 7 and 9 subsamples. The 
intercorrelation between the two subscales is .70 at 
grade 7 and .67 at grade 9. Table 1 5 gives the reliability 
estimates obtained through criterion-referenced scoring 
and shows the proportion of students meeting each 
criterion level. 



Validity 

A 36-item version of this scale was administered 
to 130 high school students in a suburban EMttsburgh 
school. Teachers identified high-middle-low interest 
groups based upon their observations of student 
behavior patterns in school. The scale discriminated 
between the high and low groups and the middle and 
low groups but failed to discriminate significantly 
between the middle and high groups. 
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GOAL V: CITIZENSHIP 



Goal Sutement 

Quality education should help every child acquire 
the habits and attitudes associated with responsible 
citizenship. 

Goal Rationale 

Responsible citizenship embodies a much more 
complex con,jept than commonly expressed in love of 
country and participation in the democratic processes. 
Viewed in its broadest sense responsible citizenship 
implies a respect for law and proper authority, a 
willingness assume responsibility for our own actions 
and for thusc of the groups to which we belong, respect 
for the rIlih^^ of oihei^ and overall personal integrity 

School> -should encourage pupils to be willing to 
assume responsibility for their actions as weH as the 
actions of the group Opportunities should be provided 
for pupils to cooperate and work toward grouo coals 
and to demonstrate integrity in dealing with otners 
Pupils should be given the chance to take the initiative 
and assume leadership for group action as well as lend 
support to eroup efforts as followers. 

Measurement Rationale 

The mores, codes, laws and social expectations of 
society provide the reference points for judging which 
behaviors reflect "responsible" citizenship and which 
behaviors indicate 'poor" citizenship. A review of 
literature revealed ^hat the National Assessment of 
Educational Progress developed nine general citizenship 

objectives The criterion for inclusion of any one 
objective was it& relative importance to society as agreed 
upon by d oonmiitttv of scholars and lay people. 

These nat)ona> objectives were used to provide the 
frame ot reterence for what was to be measured. 
Objectives m the cognitive domain such as (a) knowing 
structure of government and (b) understanding 
problems of miernational relations were excluded from 
consideration m developing the scale. 

Arriving at a satisfactory definition of citizenship 
was much less complicated than applying the definition 
to the assessment of students* attitudes and behaviors. 



The display of responsible citizenship behaviors like 
"honesty" or "integrity" are most often situational. 

A student's display of good citizenship behavior 
under one set of motivating conditions tells us little 
about the way he or she can be expected to behave 
if those conditions are altered. The context in which 
the behavior is elicited therefore becomes at least as 
important in determining the outcome as the 
predisposition of the individual involved. 

One way of overcoming this problem is to utilize 
a behavior-referenced model which incorporates 
elements related to the psychological notion of 
"threshold" Used in reference to citizenship, threshold 
refers to that set of conditions necessary to bring about 
the desirable responses. Thus by varying the situation 
and introducing conditions of reward and punishment 
we are able to determine the cutoff levels at which the 
student will display positive behavior. In this way it 
IS possible to assess not only the students' predisposition 
to behave in a manner consistent with responsible 
citizenship but also to provide some measure of the 
intensity of that predisposition across a spectrum of 
situations. 



General Scale Description* 

Fifty-four items measure willingness to exhibit 
good citizenship in many social situations under a 
variety of motivating conditions. Social contexts are 
given by 18 stories, each posing a problem and 
suggesting an action predefined as good or poor 
Citizenship. Each story has three items which list 
positive or negative consequences resulting from the 
action. Students are asked to decide whether to take 
the action for each consequence. 



Sample Story: 

Morton has broken a school window but did not 
mean to. If I were Morton, 1 would TELL THE 
PRINCIPAL or teacher about my breaking the 
window when I knew... 



♦Nolan F. Russell from the Division of Educational Quality Assessment is the author of the citizenship scale. 
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Sample item set: 



1. The principal 
would make me 
stay after 
school. 

2. My parents 
would have to 
pay for the 
window. 

3. 1 would have 
to pay for the 
window. 



Yes 



Maybe 



M 



M 



M 



No 



N 



N 



N 



The items within the scale are grouped in such a 
way as to yield three subscale scores in addition to a 
total score. 

Subscale 1: 

Concern for the welfare atid dignity of others 
contains 15 items (item sets from five stories) 
designed to measure concern for the feelings of 
others, willingness to protest unjust treatment of 
others, and the tendency to accept new people into 
a group. Also measured is the degree of restraint 
from teasing or degrading others. 

Subscale 2: 

Respect for law and authority has 21 items 
measuring the willingness to report law-breaking of 
others, obey authorities during emergencies, and 
prevent classroom disruptions. Also assessed is the 
degree of restraint from violent actions that could 
harm others or damage property. 

Subscale 3: 

Personal responsibility and integrity has 18 items 
which tap the willingness to honor self-made 
commitments to individuals or groups and the 
willingness to take responsibility for one's own 
mistakes and to report mistakes made in one's 
favor. 



Norm-Referenced Scoring 

The following item weighting scheme is used for 
norm-referenced scoring: 



Behavior 
Direction 

Plus Citizenship 

Minus Citizenship 



Response Options 

Yes Maybe No 
2 1 0 

0 1 2 



Criterion-Referenced Scoring 

Responses are considered "favorable** when they 
reflect a willingness to display proper citizenship 
behaviors or an unwillingness to use poor citizenship 
behaviors. A student's score on a given scale (total or 
subscale) is the percentage of items to which a favorable 
response was given. For the citizenship scale the scoring 
scheme applied to the items is: 



Behavior Direction 



Positive Citizenship 
Negative Citizenship 



Response Choices 
Yes Maybe No 
1 0 0 
0 0 1 



Each student's score is then compare to a 
standard having three levels. To meet level one the 
student must respond favorably to more than 35 per 
cent of the items. To meet level two the student must 
respond favorably to more than 51 per cent of the 
items. Level three requires students to choose favorable 
response choices to more than 70 per cent of the items. 



Technical Properties 

The stories used in this scale have a reading 
difficulty level of 4.9 w^le the items have a reading 
level of 4.0. Reliabilities computed across low, average 
and high achiever groups (as defined by scores on the 
composite math-verbal scales) were .86, .94 and .95 at 
grade 7 and .89, .94 and .95 at grade 9. 

Tables 16 and 17 present selected technical 
characteristics based on norm^'ef^renced scoring for 
grades 7 and 9 respectively. Table 20 displays the 
reliabilities found for the total scale and subscales at 
three criterion levels and gives the proportion of 
students meeting each criterion. 
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Validity 

The degree of correspondence between what one 
"says*' on a paper and pencil test and what one actually 
"does" in real situations is an important consideration 
when evaluating a test. In January 1972 a study was 
conducted to determine the efficacy of an 88-item 
version of the citizenship scale to discriminate between 
persons independently identified as displaying poor 
interpersonal and social adjustment to those not so 
identified. 

The study was conducted in a home for wayward 
girls located in western Pennsylvania. The institution has 
a "stared** policy of periodic appraisal (every three 
months) ijf each resident's social and emotional 
adjustment. Evaluations are made by a three member 
team including a psychologist, a case worker and a 
cottage attendant. Characteristics which are evaluated 
include personal responsibility, honesty, fighting 
behaviors and ability to get along with others. 
Assignments to living quarters are made contingent 
upon the above evaluations. As a girl's adjustment 
improves, she is moved to another cottage with girls 
of similar adjustment and with more privileges. There 
are five cottage units in the institution with cottage 
number five housing the "most adjusted" of the 
residents. 

The scale was administred to the entire population 
of girls (N = 46) living in the institution. For purposes 
of analysis the girls were separated into two groups. 



Those living in the first three cottages formed group 
one Cmost maladjusted" N = 25). Group two ("most 
adjusted" N = 21) was composed of girls housed in 
cottages four and five. 

Analyses revealed that the citizenship scale could 
(1) discriminate between these two groups (the adjusted 
group scoring higher) and (2) discriminate between the 
total institutional group and a group of public school 
children having similar home background (the public 
school group scoring higher). 

It is of some interest to note that upon 
interrogating the data received from the institution two 
cases were discovered within the "adjusted" group 
which displayed extremely low scores in relation to 
others in that group. Further checking with the 
institution personnel revealed that these two individuals 
were new admissions who had been placed in the upper 
cottages until they could be evaluated and had not 
earned admission to these cottages via the usual 
evaluative procedure. These were the only two girls in 
the institution who were placed in cottages without 
prior evaluation. 

A similar study conducted in April 1973 used boys 
residing in a Youth Development Center in western 
Pennsylvania. A Sl^item version of the citizenship scale 
discriminated between a group of new arrivals and a 
group of residents ready to be released (the latter group 
scoring higher). 
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TABLE 18 



CORRELATION MATRIX BETWEEN SUBSCALES 
FOR CITIZENSHIP SCALE: GRADE 7 



SUBSCALE NAME 



SUBSCALE NAME 



Concern for 
Welfare of Others 



Respect for Law 
and Authority 



Respect for Law 
and Authority 



.65 



Responsibility 
and Integrity 



.66 



.68 



TABLE 19 

CORRELATION MATRIX BETWEEN SUBSCALES 
FOR CITIZENSHIP SCALE: GRADE 9 



SUBSCALE NAME 



SUBSCALE NAME 



Concern for 
Welfare of Others 



Respect for Law 
and Authority 



Respect for Law 
and Authority 



.62 



Responsibility 
and Integrity 



.65 



.69 
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GOAL VI: HEALTH HABITS 



Goal Statement 

Quality education should help every child acquire 
good health fiabits and an understanding of the 
conditions necessary for the maintenance of 
physical and emotional well-being. 

Goal Rationale 

In their own interest, as well as in the interest of 
society at large, children should know how to take care 
of themselves and how to keep physically fit. They 
should know what the requirements are for physical and 
mental health and what practices, harmful to health, 
should be avoided. After gaining this knowledge they 
should acquire habits of actions which increase the 
probability to rem- ^n healthy and fit throughout life. 

In cases whei^ the home has been deficient in 
encouraging the child to practice sound health habits, 
the school has an obligation to be aware of the situation 
and to see that opportunities to remedy the deficiency 
are provided. 

Measurement Rationale 

Understanding how principles such as disease and 
their prevention, dental care, nutrition, personal 
hygiene, safety and drug use relate to the structure and 
function of the human body is an important first step 
in each individual's health related development. More 
important, however, is the individual's willingness to 
consistently exhibit habits which are conducive to the 
maintenance of personal health and well-being. One 
does not need to be a doctor to display good health 
practices or a lawyer to display good citizen behaviors. 

Therefore, assessment in this goal area attempts to 
get at students' willingness to display proper health 
behaviors in a variety of situational contexts. 

General Scale Description* 

The scaling technique developed for use in tliis 
inventory is similar to the psychophysical method of 
limits. This method holds the behavior constant while 
systematically allowing the stimuli to vary. The strength 
of the stimulus (in physical units) which is required to 
cause a change in the behavior is u' ?d to define the 
threshold of that behavior. 



In the case of this health behavior inventory, the 
student is asked to decide whether he or she would 
take a given health-related action. Each action is 
predefined as indicating either good or poor health 
practice. Stimulus contexts surrounding the choices are 
systematically varied. The health-behavior threshold is 
defined in terms of the severity of the stimulus contexts 
tolerated before changing from good to poor health 
behavior. More specifically performance is used to infer 
health-behavior threshold by identifying the supportive 
contingencies in the environment necessary to maintain 
good health practices. 

The format of each question takes the form of 
a situational story about a make-believe junior high 
student. The respondent is first asked to consider taking 
a specific action. In each question three 
motivation-inducing conditions, i.e., rewards and 
punishments, are made contingent upon the taking of 
the action. 

Sample story: 

When Norma had the flu the doctor g^^ve her some 
medicine. The medicine also took away the 
stomach ache Norma had. After she got over tlie 
flu. Norma had another stomach ache. If I were 
Norma, I would TAKE THE MEDICINE AGAIN 
when I thought... 

Sample item set: 

Yes Maybe No 

1. The medicine tasted 

good. Y M N 

2. It might cure my 
stomach ache 

quickly. Y M N 

3. My parents might 
not want me to 

take it. Y M N 

The items within the scale were grouped in such 
a way as to yield three subscale scores in addition to 
a total scale score. 

Subscale 1: 

Persoml and community health contains 21 items 
(seven health situations). Content includes 
willingness to follow proper diet, to take proper 
medical precautions, to use good personal hygiene 
practices and to refrain from interpersonal 
contacts when ill. 



♦The health habits scale was developed jointly by Nolan F. Russell and Eugene W. Skiffington from the Division 
"of Educational Quality Assessment and Mary L. Lydon tVom the Division of Research. 
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Subscaie 2: 



Personal and community safety contains 1 8 items 
from six health situations. Measured is the degree 
of restraint from unnecessary risk-taking at home, 
at school and at play and restraint from submitting 
others to undue risks. 



Subscaie 3: 



Drugs contain five situations with 1 5 questions to 
measure restraint from (1) improper use of 
prescription drugs, (2) experimentation with drugs 
and (3) maintaining close contact with otiiers who 
are using drugs. Improper use of prescription drugs 
includes restraint from using old medicine, 
medication prescribed for others, or more medicine 
than has been prescribed by the doctor. 



Norm-Referenced Scoring 

For norm-reference scores, the following item 
weighting scheme is used: 

Response Options 
Behavior Direction Yes Maybe No 

Plus Health Behavior 2 1 0 

Minus Health Behavior 0 1 2 

Criterion-Referenced Scoring 

Responses are considered favorable when they 
reflect a willingness to take good health-related actions 
or an unwillingness to display behaviors that might be 



harmful to health. A student's score on a given scale 
(total or subscaie) is the percentage of items to which 
a favorable response was given. For the health scale the 
scoring scheme applied to the items is: 



Behavior Direction 



Good Health Practice 



Poor Health Practice 



Response Choices 
Yes Maybe No 
1 0 0 

0 0 1 



Each student's score is then compared to a 
standard having three levels. To meet level one the 
student must respond favorably to more than 35 per 
cent of the items. To meet level two the student must 
respond favorably to more than 51 per cent of the 
items. Level three requires students to choose favorable 
response choices to more than 70 per cent of the items. 



Technical Properties 

The grade level readability for the stories used in 
the health habits scale is 4.8. The items associated with 
the stories have a readability level of 3.9. Reliabilities 
computed across low, average and high achievement 
groups as defined by composite math-verbal scores were 
.83, .91 and .92 for grade 7 and .86, .92 and .93 for 
grade 9. 

Tables 21 and 22 present selected technical 
characteristics derived from analyses using 
no. m-referenced data from grades 7 and 9 respectively. 
Tables 23 and 24 show the intercorrelations between 
subscaies. Table 25 gives the reliabilities associated with 
each of the three criterion levels and shows the 
proportion of students meeting each criterion. 
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TABLE 23 



CORRELATION MATRIX BETWEEN SUBSCALES FOR 
HEALTH HABITS SCALE: GRADE 7 



SUBSCALE NAME 

SUBSCALE NAME Personai Health Safety 

Safety .52 

Drugs .46 .61 



TABLE 24 

CORRELATION MATRIX BETWEEN SUBSCALES FOR 
HEALTH HABITS SCALE: GRADE 9 



SUBSCALE NAME 

SUBSCALE NAME Personal Health Safety 

Safety .53 

Drugs .46 .59 
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GOAL Vll: CREATIVITY 



Goal Statement 

Quality education should give every child 
opportunity and encoura^^ement to be creative in 
one or more fields of endeavor. 



Goal Rationale 

The notion of creativity has been variously 
defined. It is being used here to encompass worthwhile 
activities that children initiate and pursue on their own 
- activities having an oulcome that is perceived by the 
children themselves or by others as a contribution to 
some part of their world. Such activities can be found 
in a wide variety of fields, not only the sciences and 
the arts, but also the organization of human affairs and 
the development and exercise of salable skills in the 
production of any of a host of practical things that 
enrich our way of living. 

The school should offer an environment which will 
encourage and reinforce those activities that can enable 
children to express themselves creatively and 
productively. 

Measurement Rationale 

Attempts to assess creativity have traditionally 
utilized methods which analyze the various components 
of the creative process or subjective judgments about 
the quality of the product of the creative act. Neither 
of these procedures is particularly well adapted to a 
large scale assessment effort which covers the broad 
spectrum of creative talent represented in the school. 
In order to overcome this problem a two-dimensional 
model of creativity was proposed which provided a 
theoretical basis for the assessment of Goal VII. The 
first dimension is based on the student-expressed 
interest in becoming engaged in creative activities, while 
the second attempts to determine the extent of 
recognition gained through active involvement. This 
approach seems sound since the Goal VII statement 
stresses opportunities and encouragement for all 
students relative to creativity rather than emphasizing 
selective creative output. 

General Scale Description* 



The creative activities checklist contains 36 
activities which require originality in the areas of visual 
arts, performing arts, science and writing. Sample 
activities include: performed an original scientific 
experiment using living things; written an original poem; 
modeled an outfit using own style; performed using an 
original nagic or novelty act. 

Response options give six ways to show degree of 
involvement in each activity. Options are (l)No, and 
have not wanted to; (2) No, but have wanted to; (3) 
Yes, but with no recognition; (4) Yes, with teacher or 
adult leader recognition; (5) Yes, with school-wide 
recognition; and (6) Yes, with area-wide recognition. 
The scale contains four subscales each having nine items. 

Subscale 1 : 

Visual arts contains nine items, some dealing with 
more than one activity, are included in this 
subscale. Activities include sculpturing, cartooning, 
printmaking, graphic design, painting, 
photography, flower arrangement, design of 
window displays, stage sets, decorative items and 
clothing. 

Subscale 2: 

Performing arts contain nine items which include 
activities dealing with singing, speech, music, 
magic, modeling, directing, acting and sports. 

Subscale 3: 

Writing arts contain nine items related to writing 
such as poetry, news, essays, stories, scripts, letters, 
jokes and recipes. 

Subscale 4: 

Science activities contain nine items such as 
performing experiments using physical objects or 
living things, constructing models to show a 
scientific principle, exploring, training animals, 
directing recreational activities, developing 
campaign strategies for (school) elections, working 
with radios or other electronic equipment, and 
designing gadgets. 



♦The creativity scale was developed by James F. Hertzog and Nolan F. Russell both from the Division of 
Educational Quality Assessment. 
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Norm-Referenced Scoring 

All items in this scale are positively worded. Each 
item describes an activity and asks the students to 
describe the level of their involvement in that activity. 



Response Options Score Obtained 

(1) No, and have not wanted to. 0 

(2) No, but have wanted to. 1 

(3) Yes, but no recognition. 2 

(4) Yes, with teacher or adult 

leader recognition. 3 

(5) Yes, with school-wide recognition. 4 

(6) Yes, with area-wide recognition. 5 



Criterion-Referenced Scoring 

Two ciiterion-referenced scoring methods are used 
for this scale. The first defines as "favorable" those 
choices which reflect a willingness to try the activities 
presented in the scale. Thus only the option "No, and 
have not wanted to" is considered unfavorable. Scores 
generated from this method are called Attitude Toward 
Creative Activities. 

The second scheme defines as "favorable" those 
choices indicating that the student has actually 
participated in the activity. Thus two choices are 
considered unfavorable: "No, and have not wanted to" 
and "No, but have wanted to. " 



The two scores obtained by each student are then 
compared to a standard having three levels. To meet 
level one the student must respond favorably to more 
than 35 per cent of the items. To meet level two the 
student must respond favorably to more than 51 per 
cent of the items. Level three requires the student to 
choose favorable response choices to more than 70 per 
cent of the items. 



Technical Properties 

The grade level readability for the creativity scale 
is 6.7. Reliability coefficients based on low, average and 
high achievement groups as defined by composite scores 
on the math-verbal scales were found to be .92, .90 
and .89 at grade 7 and .91, .91 and .90 at grade 9. 
This scale is the only EQAI instrument which does not 
contain reflected items. Therefore, it is important to 
estimate the amount of influence response bias has on 
total scale scores. This was done by finding the number 
of students in the grade 7 and 9 subsamples who 
obtained perfect scores on the scale. To get a perfect 
score the student must choose response choice six which 
reads "Yes, I have done this activity and have received 
area-wide recognition for its quality. " Of course, no 
youngster could have realistically received area-wide 
recognition for all 36 activities. Only one student out 
of the 5,894 students in these two samples obtained 
a perfect score. 

Tables 26 and 27 present selected norm-referenced 
properties of the creativity scale for grade 7 and 9 
respectively. Tables 28 and 29 display the 
intercorrelations between the subscales. Tables 30 and 
31 give the internal consistency reliabilities associated 
with each of the three criterion levels and shows the 
proportion of students meeting each criterion for each 
of the two criterion-referenced scoring methods. 
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TABLE 28 



CORRELATION MATRIX BETWEEN SUBSCALES FOR 
CREATIVE ACTIVITIES SCALE: GRADE 7 









SUBSCALE NAME 




SUBSCALE NAME 


Visual Arts 


Performing Arts 


Science 


Performing Arts 


.66 






Science 


.68 


.66 




Writing 


.64 


.68 


.61 



TABLE 29 

CORRELATION MATRIX BETWEEN SUBSCALES FOR 
CREATIVE ACTIVITIES SCALE: GRADE 9 



SUBSCALE NAME 


Visual Arts 


SUBSCALE NAME 
Performing Arts 


Science 


Performing Arts 


.64 






Science 


.64 


.63 




Writing 


.62 


.66 


.56 
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GOAL Vlll: VOCATIONAL DEVELOPMENT 



Goal Statement 

Quality education should help every child 
understand the opportunities open to him for 
preparing himself for a productive life and should 
enable him to take full advantage of these 
opportunities. 



thought to relate to becoming a productive working 
member of society. The second explores the knowledge 
base thought necessary to make appropriate 
educational-vocational decisions. 



General Scale Description'*' Vocational Attitude 



Goal Rationale 

Students should be aware of the xnsi array of 
possibilities for continuing self-<levelopment in the 
world of work so that they will be motivated to pursue 
excellence in all forms of human endeavor that are 
appropriate for them individually. 

Most children can profit from some form of 
education beyond high school, whether it be a four-year 
college, a school of nursing, a coimnunity college, a 
technical institute or the like. Each student should be 
aware of these opportunities and seek out the particular 
kind of education best suited to his or her talents and 
interests. This goal also implies that the school will 
provide students with the kind of guidance that will 
enable them to do so. 



Measurement Rationale 

Vocational development, for purposes of 
assessment, is considered to be a series of processes 
involving both the acquisition of knowledge about 
different kinds of work and the forming cf attitudes 
which will enhance one's chances of succeeding in the 
work-a-day world. 

In the initial stages of vocational maturity students 
become aware of different kinds of work and workers. 
This is followed by a growing understanding of the 
reiatedness of educational and occupational 
opportunities. The more vocationally mature students 
will show involvement in the choice process by actively 
seeking information, accepting personal responsibility 
for career decisions and finally basing their career 
choices upon a realistic appraisal of their interests, 
achievementsand aptitudes. 

Two separate scales were developed in this goal 
area. The first deals with those attitudes which are 



Twenty-six items measure attitude toward work, career 
choice and efforts at establishing long-range educational 
plans. Nine items reflect a positive vocational attitude, 
e.g., '7 am having no difficulty preparing myself for 
work I want to do. " Seventeen items are worded to 
reflect vocational immaturity, e.g., "Why try to decide 
upon a fob when the future is so uncertain?'* Response 
options are (1) agree, (2) mostly agree, (3) mostly 
disagree and (4) disagree. This scale has no subscales. 



Norm-Referenced Scoring 

The following item weighting scheme is used for 
norm-referenced scoring: 



Item 

Direction Agree 
Plus Statements 3 
Minus Statements 0 



Criterion-Referenced Scoring 



Response Options 

Mostly Mostly 

Agree Disagree Disagree 



0 
3 



Responses are considered "favorable" when they 
reflect vocationally mature attitudes. The scoring 
scheme used for this scale is as follows: 



Item 

Direction 



Agree 



Response Choices 

Mostly Mostly 

Agree Disagree Disagree 



Plus Statements 1 
Minus Statements 0 



1 

0 



0 

I 



0 

1 



ERIC 



*The vocational attitude scale is a result of extensive revisions of the Goal VIII instrument which was used 
for grades 5 and 11. Richard L. Kohr and J. Robert Coldiron from the Division of Educational Quality Assessment 
were responsible for the revisions. 
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M'dch student's score is then compared to a 
standard having three levels. To meet level one the 
student must respond favorably to more than 35 per 
cent of the items. To meet level two the student must 
respond favorably to more than 51 per cent of the 
items. Level three requires the student to choose 
favorable response choices to more than 70 per cent 
of the items. 



General Scale Description: Vocational Knowledge* 

This scale contains 30 items, which focus on the 
student's knowledge concerning the duties, training and 
educational requirements of various occupations. The 
multiple-choice format requires the student to select the 
best answer from four alternatives. 

Sample item (occupational duties): 

What kind of work does a surveyor usually do? 

A. oversees workers in a factory 

*B. determines property boundaries 

C. conducts public opinion polls 

D. designs roads anr* highways 

Sample item (education): 

The lowest level of education you would need to be 
a lawyer is: 

A. high school graduate 

B. 1-3 years of school after high school (not 
college graduate) 

C. college graduate 

*D. graduate or professional degree 



Sample item (training): 

Which of these jobs requires a period of apprenticeship? 

A. truck driver 

B. stockbroker 

C. porter 
*D. electrician 

Norm-Referenced Scoring 

One point is given for each correct answer. There 
is no scoring adjustment for guessing. 

Technical Properties 

Tables 32 and 33 present selected technical 
properties of the vocational attitude and vocational 
knowledge scales for grades 7 and 9 respectively. Note 
that the internal consistency estimates for the 
knowledge scale are based on the KR-20 formula while 
the coefficient alphas are used for the attitude 
instrument. 

The grade level readability for the vocational 
attitude scale is 7.0. Coefficient alphas for the total 
scale computed across three ability groups (low, average, 
high) as defined by scores on the composite math-verbal 
scales were .60, .63 and .66 for grade 7 and .63, .66 
and .71 at grade 9. 

Internal consistency reliabilities associated with the 
three criterion levels were found to be .95, .80 and .71 
at grade 7 and .97, .81 and .54 at grade 9. The 
proportion of students meeting each criterion were ,98, 
.83 and .38 at grade 7 and .99, .89 and .50 at grade 
9. 



ERLC 



*The authors of the vocational knowledge scale are Francis J. Reardon and James P. Lewis from the Division 
of Research. 
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GOAL IX: APPRECIATING HUMAN ACCOMPLISHMENTS 



Goal Sutement 

Quality education should help every child to 
understand and appreciate as much as he can of 
human achievement in the natural sciences^ the 
social sciences, the humanities and the arts. 



aiiiiudes concerned with the degree of value placed by 
students on various areas of human accomphshment and 
the willingness of students to seek out onvironmenis 
where first hand experience in these endeavors would 
be possible. 



Goal Rationale 

Students should be encouraged and helped to gam 
knowledge about human accomplishments. Possessing 
knowledge they will then be ready to receive and not 
to avoid the stimuli thai the sciences and arts provide. 
At the next level, they will be ready to more clearly 
and consciously perceive these stimuli and will begin 
to discriminate among art forms. When they reach the 
next stage of development, they will be ready to 
respond railier than merely attend to phenomenon - 
thev will choose to see a play, to read of a famous 
scientist o? i<» contemplate the design of a building, 

Insot'ar a,s possible the school experience should 
provide an increasing openness to the life of the mind 
and an increasing abiluv \o find meaning for one's own 
life in the heritage of the past and in the mieHeciual 
tiirusls o1 the present age. 



General Scale Description 

This scale contains 46 items measuring how much 
value the students place on human achievements in the 
arts and sciences and the degree to which they are 
willing to receive stimuli that these endeavors provide. 
Areas included are literature, art, athletics, politics, 
science, music and drama. The scale is organized into 
two subscales each having 23 items, 

Subscale 1 : 

Valuing measures the amount of importance the 
student attaches to achievements in the arts and 
sciences and how much the student values the role 
Played by people in these areas. Sample item: 
"Most scientists are interested only in machines, 
not people, " 

Subscale 2: 



Measurement Rationale 

Attitudes associated with the understanding and 
appreciation of human accomplishments may be 
inferred from samplings of behavior taken at several 
points along a response hierarchy. The lowest point in 
the hierarchy is represented by those behaviors 
indicative ot a stale of passive receptivity reflecting little 
more than an awareness that certain human endeavors 
exist. At the highest point of this hierarchy are those 
overt behaviors resulting in direct involvement in the 
activities and which infer a state of high motivation. 
Between theso iwu extremes are several intermediate 
steps based « f^^e "value" placed on the activities and 
willingness receive " stimuli that these activities 
provide 

In developing the assessment model to be used in 
this goal area it was determined that the instrument 
would not attempt to sample behaviors at either 
extreme Instead items were designed to concentrate on 



Receiving measures willingness to learn more 
about achievements in the arts and sciences and 
to seek out experiences which provide first-hand 
information on what people in these areas are 
dome. Sample item: "fr would be fun to watch 
people paint at an art studio, " 



Norm-Referenced Scoring 

The item weighting scheme used for norm-referenc- 
ed scoring is: 

Response Options 
Item Direction Agree Uncertain Disagree 

Plus 2 10 

Minus 0 I 2 



*The appreciatmi! human accomplishmenf..; scale is a result of extensive revisions of the Goal IX instrument 
^^y^.usQd for grade 11 Nolan F, Russell from the Division of Educational Quality Assessment was responsible for 
Cl\lv> the revisions 
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Criterion-Referenced Scoring 

Responses to this scale are considered favorable 
when they reflect agreement with statements which (1) 
stress the value of human endeavors in the arts, sciences, 
politics, etc., or (2) suggest that it is personally 
rewarding to approach the people and places associated 
with these endeavors. For the appreciation of human 
accomplishments scale the following scoring scheme is 
ased. 



Item Direction 



Plus Statemtmts 



Minus Statements 



Response Choices 
Agree Uncertain Disagree 
I 0 0 



0 



1 



Each student *s score is then compared to a 
standard having three levels. To meet level one the 
student must respond favorably to more than 35 per 
cent of the items. To meet level two the student must 



respond favorably to more than 51 per cent of (he 
items. Level three requires the student to choose 
favorable response choices to more than 70 per cent 
of the items. 



Technical Properties 

This scale has the highest grade level readability 
(7.7) of all scales contained in EQAI. (nternal 
consistency reliabilities computed separately for low, 
average and high achiever students were found to be 
.82. .86 and .88 at grade 7 and .85. .88 and .89 at 
grade 9. The receiving and valuing subscales were found 
to be .56 at grade 7 and .64 at grade 9. 

Tables 34 and 35 present selected technical 
characteristics associated with norm-referenced scoring 
for grades 7 and 9 respectively. Table 36 gives the 
reliabilities computed for both grades at each of three 
criterion-levels. Table 36 shows the proportion of 
students meeting each criterion level. 
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GOAL X: PREPARING FOR A CHANGING WORLD 



Goal Statement 



General Scale Description* 



Quality education should help every child to 
prepare for a world of rapid change and 
uriforeseeabie demands in which continuing 
education throughout his adult life should be a 
normal expectation. 

Goal Rationale 

Ability to cope with a rapidly changing world is 
an attribute of increasing importance for today's youth. 
The development of the abilities and their associated 
attitudes which allow the individual to view change as 
an opportunity rather than a threat poses a new 
challenge for education. 

Schools should help students develop attitudes of 
openness to the possibilities of change - change in their 
personal world as well as external change. Students 
should be encouraged to show tolerance for ambiguity 
and to welcome new experiences. 



Thirty-five items measure emotional and behavioral 
reactions to change. The scale's format contains seven 
stories describing unpleasant change situations in which 
students' expectations or needs are not met. These 
situations were obtained from previous student 
statements describing events that were difficult to adjust 
to. Five reactions predefined as indicating positive or 
negative adaptation to change are given following each 
story. The purpose of the scale is to get at student 
reactions in response to a variety of events, not to 
predict what students will do in the particular situations 
presented. 

Sample items: 

I was elected class president. I came home to tell 
my parents the good news. They told me that my dad 
had taken a job out of state and we were going to move 
in two weeks. So I had to withdraw from school and 
move. 



Measurement Rationale 

Coping with change and the ability to deal 
effectively with frustration are essential ingredients in 
a concept involving personal adjustment. These adaptive 
behaviors are seldom learned in response to external 
changes of great magnitude and import but are acquired 
as part of a gradual process requiring daily changes in 
the life of the student. 

Assessment in this goal area attempts to draw upon 
several constructs believed to be associated with a 
student's ability to accommodate change and to adapt 
emotionally and behaviorally to unexpected or sudden 
alterations in the environment. Primary among these are 
measures of the student's ability to tolerate frustration, 
ambiguity and uncertainty and to apply past learnings 
and coping behaviors in new and different situations. 

The situational contexts selected as a means of 
measuring these attitudinal and behavioral dimensions 
were gleaned from student responses to open-ended 
questions asking for descriptions of events they had 
experienced which necessitated some form of adjusting 
behavior and which were remembered as being difficult 
to cope with. 



If this happened to you, how much time would 
you spend on each thing listed below: 



A Great 

Deal Some 
of Time Time 



Very 

Little No 
Time Time 



1. Getting over being 
upset. 

2. Trying to find some- 
one to stay with so 

I could remain in my 
school. 

3. Planning a going-a way 
party. 

4. Fighting with my 
parents. 

5. Reading about the 
place we are going 
to move to. 

This scale contains three subscales designed to 
delineate various behaviors and emotional reactions to 
frustration. 
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The preparing for a changing world scale was authored by Nolan F. Russell, Division of Educational Quality 
Assessment. 
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Subscale 1 ; 



Effective solutions contains 13 items to measure 
the tendency to try solutions reflecting positive 
adjustment to change. In the above, sample items 
three and five are assigned to this subscale. 



Subscale 2: 



Ineffective solutions contains 13 items to measure 
tendency to avoid use of aggressive or withdrawing 
reactions in face of change. In the above, sample 
items two and four are assigned to this subscale. 



Subscale 3: 



Emotional adjustment contains nine items to 
measure the perception of the length of time 
needed for the student to adjust emotionally to 
change. Item one above is assigned to this subscale. 



Norm-Referenced Scoring 

The item weighting scheme for norm-reference^^ 
scoring is: 



Response Options 

A Great 
No Little Some Deal 
Time Time Time of Time 



Types of Items 



Effective Solutions 0 1 2 3 

Ineffective Solutions 3 2 1 0 

Emotional Adjustment 2 2 1 0 



Criterion-Referenced Scoring 

Responses are considered "favorable" when they 
reflect (1 ) a willingness to display positive adjustment 
behaviors, (2) an unwillingness to use withdrawal or 
aggressive actions and (3) a rapid emotional adjustment 



to change. An individual's score on a given scale (total 
or subscale) is the percentage of items to which a 
favorable response was given. The item weighting 
scheme for the preparing for a changing world scale is 
as follows: 

Response Choices 



Item Type 


A Great 
Deal 
of Time 


Some 
Time 


Very 
Little 
Time 


No 
Time 


Effective Solution 


1 


1 


0 


0 


Ineffective Solution 


0 


0 


1 


1 


Emotional Adjustment 


0 


0 


1 


I 



Each student's score is then compared to a given 
standard having three levels. To meet level one the 
student must respond favorably to more than 35 per 
cent of the items. To meet level two the student must 
respond favorably to more than 51 per cent of the 
items. Level three requires the student to choose 
favorable response choices to more tfian 70 per cent 
of the items. 



Technical Properties 

The grade level readability for the story 
component of this scale is 5.5. The items have a grade 
level readability of 4.0. Coefficient alphas for the total 
scale computed across low» aveiage and high achiever 
groups as defined by scores on the composite 
math-verbal tests were .77, .82 and .85 at grade 7 and 
.76, .80 and .83 at grade 9. 

Tables 36 and 37 present selected norm-referenced 
technical characteristics of the preparing for a changing 
world scale for grade 7 and 9 respectively. Tables 39 
and 40 show the intercorrelations between the 
subscales. Table 41 gives the internal consistency 
reliabihty estimates associated with each of the criterion 
levels and shows the proportion of students meeting 
each criterion. 
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TABLE 38 



CORRELATION MATRIX BETWEEN SUBSCALES FOR 
PREPARING FOR A CHANGING WORLD SCALE: GRADE 7 



SUBSCALE NAME 

Effective Ineffective 
SUBSCALE NAME Solution Solutions 

Ineffective 

Solutions .31 
Emotional 

Adjustment -.07 .40 



TABLE 39 

CORRELATION MATRIX BETWEEN SUBSCALES FOR 
PREPARING FOR A CHANGING WORLD SCALE: GRADE 9 



SUBSCALE NAME 

Effective Ineffective 
SUBSCALE NAME Solution Solution 



ineffective 

Solutions .31 
Emotional 

Adjustment -.12 .34 
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SECTION THREE 



Target Groups for Program Focus 



Ideally, when preparing to initiate a program to 
facilitate student progress in any goal area, one should 
be able to identify students most likely to benefit from 
that program. However, information available to schools 
participating in Pennsylvania's Educational Quality 
Assessment program does not contain data on individual 
students. Co' ^equently, it is impossible for school 
personnel to identify by name the members of the 
target group toward which a program might be focused. 

Even though individual recoids are unavailable, it 
is possible to organize data in such a way as to help 
identify general student groups having difficulty in a 
goal area. 

This was done by summarizing data for various 
subgroups of students formed from selected student 
characteristics. The three student characteristics used in 
these analyses were ability level, sex and father's 
occupation. 

Student ability was categorized into three levels 
on the basis of the composite math-verbal achievement 
score. Students scoring below the 30th percentile were 
placed in the low ability group. Students scoring 
between the 30th and 70th percentile were placed in 
the middle ability group. Those exceeding the 70th 
percentile were assigned to the high ability group. 



Students were assigned to three groups on the basis 
of their reported father's or legal guardian's occupation. 
These occupation categories are labeled for convenience 
as semi-skilled, skilled and professional. These categories 
are abstractions based upon the average educational 
requirements necessary to obtain the job and the 
average amount of compensation for the particular 
occupations. It is recognized here that there are 
exceptions in any or all of these categories. The 
semi-skilled occupational category includes hospital 
attendant, laborer, operator of industrial equipment, 
packer, wrapper, miner, quarry worker, painter, roofer. 



paperhanger, carpet layer, truck driver, taxi driver, 
service station attendant, watchman, barber, waiter, 
cook, farmer and carpenter. 

The skilled occupational category includes 
cabinetmaker, dental technician, nurse, librarian, 
foreman, toolmaker, machinist, electrician, plumber, 
bricklayer, stonemason, heavy equipment operator, mail 
carrier, telephone operator, printer, decorator, 
policeman, firefighter, repairman, butcher, mechanic, 
tailor, forester, secretary, clerk, office worker, 
salesperson, grocer and minister. 

The professional occupational category includes 
dentist, doctor, veterinarian, architect, pilot, teacher, 
school administrator, editor, farm agent, stockbroker, 
insurance agent, real estate agent, personnel manager, 
bank official, lawyer, judge, engineer, social scientist 
and natural scientist. 

Eighteen groups were formed by taking all possible 
combinations of the three student characteristics. The 
proportion of students who responded favorably to 
more than one-half of the items comprising each scale 
was then found. Tables 43 through 51 present the 
results of these analyses. 

How to interpret these tables: 

Table 43 gives the percentage of students who met 
or exceeded the level two (51 per cent) criterion for 
the total self-esteem instrument. Note that 56 per cent 
of the 7th grade, low ability boys coming from homes 
where the father or guardian has a relatively low paying, 
low-skill occupation can meet the criterion. This can 
be contrasted to the finding that 87 per cent of the 
7th grade girls, scoring high on the math-verbal scales 
and coming from homes where parents have professional 
occupations can meet the criterion. These results suggest 
that a program aimed at the form^^r group will reach 
more students who need help in enhancing their 
self-esteem. 
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TABLE 43 



PER CENT OF STUDENTS SHOWING POSITIVE ATTITUDE: 
SELF-ESTEEM (GRADES 7^9) 



TYPE 


OF STUDENTS 




GRADE 

7 


LEVEL 
9 


Low ability 


Boys 


Semi-skilled fathers 


56% 


59% 


Low ability 


Girls 


Semi-skilled fathers 


56% 


61% 


Low ability 


Boys 


Skilled fathers 


55^-^ 


60% 


Low ability 


Girls 


Skilled fathers 


66% 


63% 


Low ability 


Boys 


Professional fathers 


69% 


62% 


Low ability 


Girls 


Professional fathers 


64% 


75% 


Middle ability 


Boys 


Semi-skilled fathers 


66% 


72% 


Middle ability 


Girls 


Semiskilled fathers 


67% 


74% 


Middle ability 


Boys 


Skilled fathers 


71% 


78% 


Middle ability 


Girls 


Skilled fathers 


73% 


70% 


Middle ability 


Boys 


Professional fathers 


80% 


75% 


Middle ability 


Girls 


Professional fathers 


74% 


78% 


High ability 


Boys 


Semi-skiller^ fathers 


74% 


86% 


High ability 


Girls 


Semi-skilled fathers 


74% 


76% 


High ability 


Boys 


Skilled fathers 


85% 


86% 


High ability 


Girls 


Skilled fathers 


83% 


83% 


High ability 


Boys 


Professional fathers 


83% 


87% 


High ability 


Girls 


Professional fathers 


87% 


83% 



Clearly, in today's world, women are playing an increasingly important role in defining the occupational 
level of the family. However, data were unavailable to reflect this trend. Therefore, we are forced to use the 
father's occupational level as a proxy for the socioeconomic condition of the home. 
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TABLE 44 

PER CENT OF STUDENTS SHOWING POSITIVE ATTITUDE: 
TOLERANCE TOWARD OTHERS (GRADES 7-9) 



GRADE LEVEL 

TYPE OF STUDENTS 7 9 



Low ability 


Boys 


Semi-skilled fathers 


68% 


69% 


Low ability 


Girls 


Semi-sicilled fathers 


80% 


83% 


Low ability 


Boys 


Skilled fathers 


74% 


, 72% 


Low ability 


Girls 


Skilled fathers 


80% 


85% 


Low ability 


Boys 


Professional fathers 


61% 


70% 


Low ability 


Girls 


Professional fathers 


68% 


91% 


Middle ability 


Boys 


Semi-skilled fathers 


74% 


78% 


Middle ability 


Girls 


Semi-skilled fathers 


84% 


95% 


Middle ability 


Boys 


Skilled fathers 


71% 


80% 


Middle ability 


Girls 


Skilled fathers 


83% 


92% 


Middle ability 


Boys 


Professional fathers 


88% 


82% 


Middle ability 


Girls 


Professional fathers 


87% 


93% 


High ability 


Boys 


Semi-skilled fathers 


77% 


93% 


High ability 


Girls 


Semi-skilled fathers 


87% 


94% 


High ability 


Boys 


Skilled fathers 


81% 


79% 


High ability 


Girls 


Skilled fathers 


93% 


97% 


High ability 


Boys 


Professional fathers 


83% 


87% 


High ability 


Girls 


Professional fathers 


92% 


98% 



Qearly, in today's world, women are playing an increasingly important role in defining the occupational 
level of the family. However, data were unavailable to reflect this trend. Therefore, we are forced to use the 
father's occupational level as a proxy for the socioeconomic condition of the home. 
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TABLE 45 

PER CENT OF STUDENTS SHOWING POSITIVE ATTITUDE: 
INTEREST IN SCHOOL (GRADES 7-9) 

GRADE LEVEL 

TYPE OF STUDENTS 7 9 



Low ability 


Boys 


Semi-skilled fathers 


50% 


53% 


Low ability 


Girls 


Semi-skilled fathers 


67% 


61% 


Low ability 


Boys 


Skilled fathers 


56% 


54% 


Low ability 


Girls 


Skilled fathers 


74% 


63% 


Low ability 


Boys 


Professional fathers 


64% 


56% 


Low ability 


Girls 


Professional fathers 


68% 


61% 


Middle ability 


Boys 


Semi-skilled fathers 


61% 


66% 


Middle ability 


Girls 


Semi-skilled fathers 


73% 


76% 


Middle ability 


Boys 


Skilled fathers 


68% 


67% 


Middle ability 


Girls 


Skilled fathers 


73% 


67% 


Middle ability 


Boys 


Professional fathers 


76% 


71% 


Middle ability 


Girls 


Professional fathers 


77% 


67% 


High ability 


Boys 


Semi-skilled fathers 


75% 


74% 


High ability 


Girls 


Semi-skilled fathers 


68% 


79% 


High ability 


Boys 


Skilled fathers 


76% 


77% 


High ability 


Girls 


Skilled fathers 


82% 


87% 


High ability 


Boys 


Professional fathers 


79% 


78% 


High ability 


Girls 


Professional fathers 


85% 


78% 



□early, in today's world, women are playing an increasingly important role in defining the occupational 
level of the family. However, data were unavailable to reflect tliis trend. Therefore, we are forced to use the 
father's occupational level as a proxy for the socioeconomic condition of the home. 
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TABLE 46 



PER CENT OF STUDENTS SHOWING POSITIVE ATTITUDE: 
CITIZENSHIP (GRADES 7-9) 



GRADE LEVEL 

TYPE OF STUDENIS 7 9 



Low ability 


Boys 


Semi-skilled fathers 


13% 


13% 


Low ability 


Girls 


Semi-skilled fathers 


19% 


28% 


Low ability 


Boys 


Skilled fathers 


9% 


11% 


Low ability 


Girls 


Skilled fathers 


32% 


28% 


Low ability 


Boys 


Professional fathers 


19% 


22% 


Low ability 


Girls 


Professional fathers 


27% 


30% 


Middle ability 


Boys 


Semi-skilled fathers 


20% 


18% 


Middle ability 


Girls 


Semi-skilled fathers 


47% 


46% 


Middle ability 


Boys 


Skilled fathers 


28% 


23% 


Middle ability 


Girls 


Skilled fathers 


39% 


' 35% 


Middle ability 


Boys 


Professional fathers 


36% 


24% 


Middle ability 


Girls 


Professional fathers 


51% 


32% 


High ability 


Boys 


Semi-skilled fathers 


37% 


38% 


High ability 


Girls 


Semi-skilled fathers 


50% 


51% 


High ability 


Boys 


Skilled fathers 


49% 


30% 


High ability 


Girls 


Skilled fathers 


56% 


51% 


High ability 


Boys 


Professional fathers 


43% 


27% 


Higli ability 


Girls 


Professional fathers 


51% 


45% 



Qearly, in today's world, women are playing an increasingly important role in defining the occupational 
level of the family. However, data were unavailable to reflect this trend. Therefore, we are forced to use the 
father's occupational level as a proxy for the socioeconomic condition of the home. 
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TABLE 47 



PER CENT OF STUDENTS SHOWING POSITIVE ATTITUDE; 
HEALTH HABITS (GRADES 7-9) 



TYPE 


OF STUDENTS 




GRADE 

7 


LEVEL 
9 


Low ability 


Boys 


Semi-skilled fathers 


20% 


28% 


Low ability 


Girls 


Semi-skilled fathers 


30% 


37% 


Low ability 


Boys 


Skilled fathers 


18% 


27% 


Low ability 


Girls 


Skilled fathers 


39% 


36% 


Low ability 


Boys 


Professional fathers 


29% 


25% 


Low ability 


Girls 


Professional fathers 


35% 


39% 


Middle ability 


Boys 


Semi-skilled fathers 


31% 


44% 


Midole ability 


Girls 


Semi-skilled fathers 


52% 


61% 


Middle ability 


Boys 


Skilled fathers 


45% 


41% 


Middle ability 


Girls 


Skilled fathers 


54% 


49% 


Middle ability 


Boys 


Professional fathers 


60% 


47% 


'*<idle ability 


Girls 


Professional fathers 


57% 


43% 


High ability 


Boys 


Semi-skilled fathers 


53% 


51% 


High ability 


Girls 


Semi-skilled fathers 


55% 


60% 


High ability 


Boys 


Skilled fathers 


61% 


52% 


High ability 


Girls 


Skilled fathers 


64% 


58% 


High ability 


Boys 


Professional fathers 


58% 


52% 


High ability 


Girls 


Professional fathers 


63% 


57% 



Qearly. in today's world, women are playing an increasingly important role in defining the occupational 
level of the family. However, data were unavailable to reflect this trend. Therefore, we are forced to use the 
father's occupational level as a proxy for the socioeconomic condition of the home. 
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TABLE 48 



PER CENT OF STUDENTS SHOWING POSITIVE ATTITUDES: 
CREATIVE ACTIVITIES (GRADES 7-9) 



TYPE 


OF STUDENTS 




GRADE 

7 


LEVEL 
9 


Low ability 


Boys 


Semi-skilled fathers 


80% 


59% 


Low ability 


Girls 


Semi-skilled fathers 


71% 


57% 


Low ability 


Boys 


Skilled fathers 


77% 


64% 


Low ability 


Girls 


Skilled fathers 


73% 


60% 


Low ability 


Boys 


Professional fathers 


73% 


58% 


Low ability 


Girls 


Professional fathers 


67% 


66% 


Middle ability 


Boys 


Semi-skilled fathers 


62% 


53% 


Middle ability 


Girls 


Semi-skilled fathers 


68% 


61% 


Middle ability 


Boys 


Skilled fathers 


62% 


51% 


Middle ability 


Girls 


Skilled fathers 


67% 


52% 


Middle ability 


Boys 


Professional fathers 


69% 


62% 


Middle ability 


Girls 


Professional fathers 


67% 


61% 


High ability 


Boys 


Semi-skilled fathers 


58% 


55% 


High ability 


Girls 


Semi-skilled fathers 




65% 


High ability 


Boys 


Skilled fathers 


68% 


57% 


High ability 


Girls 


Skilled fathers 


74% 


67% 


High ability 


Boys 


Professional fathers 


64% 


52% 


High ability 


Girls 


Professional fathers 


75% 


61% 



Clearly, in today's world, women are playing an increasingly important role in defining the occupational 
level of the family. However, data were unavailable to reflect this trend. Therefore, we are forced to use the 
father's occupational level as a proxy for the socioeconomic condition of the home. 
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TABLE 49 

PER CENT OF STUDENTS SHOWING POSITIVE ATTITUDE: 
VOCATIONAL DEVELOPMENT (GRADES 7-9) 

GRADE LEVEL 

TYPE OF STUDENTS 7 9_. 



Low ability 


Boys 


Semi-skilled fathers 


68% 


81% 


Low ability 


Girls 


Semi-skilled fathers 


63% 


85% 


Low ability 


Boys 


Skilled fathers 


72% 


80% 


Low ability 


Girls 


Skilled fathers 


78% 


86% 


Low ability 


Boys 


Professional fathers 


79% 


84% 


Low ability 


Girls 


Professional fathers 


78% 


82% 


Ivliddle ability 


Boys 


Semi-skilled fathers 


87% 


90% 


Middle ability 


Girls 


Semi-skilled fathers 


83% 


90% 


Middle ability 


Boys 


Skilled fathers 


82% 


92% 


Middle ability 


Girls 


Skilled fathers 


93% 


94% 


Middle ability 


Boys 


Professional fathers 


94% 


85% 


Middle ability 


Girls 


Professional fathers 


94% 


91% 


High ability 


Boys 


Semi-skilled fathers 


92% 


92% 


High ability 


Girls 


Semi-skilled fathers 


90% 


95% 


High ability 


Boys 


Skilled fathers 


93% 


89% 


High ability 


Girls 


Skilled fathers 


94% 


94% 


High ability 


Boys 


Professional fathers 


88% 


91% 


High ability 


Girls 


Professional fathers 


91% 


94% 



Qearly, in today's world, women are .playing an increasingly important role in defining the occupational 
level of the family. However, data wer6 unavailable to reflect this trend. Therefore, we are forced to use the 
father's occupational level as a proxy for the socioeconomic condition of the home. 
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TABLE SO 



PER CENT OF STUDENTS SHOWING POSITIVE ATTITUDE: 
APPRECIATING HUMAN ACCOMPLISHMENTS (GRADES 7-9) 



GRADE LEVEL 

TYPE OF STUDENTS 7 9_ 



Low ability 


Boys 


Semi-skilled fathers 


28% 


22% 


Low ability 


Girls 


Semi-skilled fathers 


40% 


37% 


Low ability 


Boys 


Skilled fathers 


18% 


21% 


Low ability 


Girls 


Skilled fathers 


40% 


41% 


Low ability 


Boys 


Professional fathers 


23% 


16% 


Low ability 


Girls 


Professional fathers 


33% 


48% 


Middle ability 


Boys 


Semi-skilled fathers 


23% 


31% 


Middle ability 


Girls 


Semi-skilled fathers 


49% 


54% 


Middle ability 


Boys 


Skilled fathers 


34% 


24% 


Middle ability 


Girls 


Skilled fathers 


48% 


52% 


Middle ability 


Boys 


Professional fathers 


47% 


42% 


Middle ability 


Girls 


Professional fathers 


55% 


48% 


High ability 


Boys 


Semi-skilled fathers 


30% 


43% 


High ability 


Girls 


Semi-skilled fathers 


57% 


66% 


High ability 


Boys 


Skilled fathers 


48% 


45% 


High ability 


Girls 


Skilled fathers 


65% 


61% 


High ability 


Boys 


Professional fathers 


47% 


47% 


High ability 


Girls 


Professional fathers 


64% 


71% 



Qearly, in today's world, women are playing an increasingly important role in defining the occupational 
level of the family. However, data were unavailable to reflect tliis trend. Therefore, we are forced to use the 
father's occupational level as a proxy for the socioeconomic condition of the home. 
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TABLE 51 



PER CENT OF STUDENTS SHOWING POSITIVE ATTITUDE: 
PREPARING FOR A CHANGING WORLD (GRADES 7-9) 



GRADE LEVEL 

TYPE OF STUDENTS 7 9_ 



Low ability 


Boys 


Semi-skilled fathers 


66% 


66% 


Low ability 


Girls 


Semi-skilled fathers 


64% 


75% 


Low ability 


Boys 


Skilled fathers 


63% 


69% 


Low ability 


Girls 


Skilled fathers 


72% 


75% 


Low ability 


Boys 


Professional fathers 


65% 


74% 


Low ability 


Girls 


Professional fathers 


77% 


79% 


Middle ability 


Boys 


Semi-skilled fathers 


67% 


75% 


Middle ability 


Girls 


Semi-skilled fathers 


81% 


83% 


Middle ability 


Boys 


Skilled fathers 


75% 


78% 


Middle ability 


Girls 


Skilled fathers 


84% 


82% 


MiaaJe ability 


Boys 


Professional fathers 


oJvo 


Q1GL 

olvo 


Middle ability 


Girls 


Professional fathers 


82% 


84% 


High ability 


Boys 


Semi-skilled fathers 


80% 


78% 


High ability 


Girls 


Semi-skilled fathers 


84% 


82% 


High ability 


Boys 


Skilled fathers 


79% 


82% 


High ability 


Girls 


Skilled fathers 


83% 


88% 


High ability 


Boys 


Professional fathers 


86% 


89% 


High ability 


Girls 


Professional fathers 


87% 


85% 



Qearly, in today's world, women are playing an increasingly important role defining the occupational 

level of the family. However, data were unavailable to reflect this trend. Therefore, we are forced to use the 
father's occupational level as a proxy for the socioeconomic condition of the home. 
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SECTION FOUR 



Relationships among Scales 



The EQAI contains 12 major composite scales 
designed to measure student growth in the 10 state 
mandated goal areas. Associated with these total scales 
are 26 subscales which further clarify student strengths 
or weaknesses relative to specific points of interest 
within these areas. In addition, the EQAI contains two 
sets of items designed to (1) assess the tendency of 
students to make themselves "look good** sind (2) to 
measure students' perception of the home environment. 
The former item-set, called the social desirability scale, 
contains nine items and has a reliability of .58 at grade 
7 and .62 at grade 9. High scores on this scale indicate 
the tendency to choose socially desirable responses. 

The individual technical characteristics of each 
total and subscale which have been presented in Section 
Two would be sufficient if each scale were administered 
separately. However, these instruments are contained 
and administered as a battery rather than in single units. 
It therefore becomes necessary to know the 
independence of each scale. Is each of the scales 
providing relevant information which is not provided 
by the other scales? How independent are the scales 
from one another? 

Tables 52 and 53 show the correlation matrix 
between all scale and subscale scores based on 
norm-referenced scoring for the 7th and 9th grade 
subsamples respectively. These correlations have been 
rounded to two decimal places and the decimal has been 
removed. A correlation greater than .18 is statistically 
significant at the .01 level of probability. 

Of primary interest are the coefficients located in 
column two of each table which present the correlations 
between scores on the social desirability scale and all 
other sub and total scales. That the correlations are 
quite small indicates the scales are relatively free from 
this type of response bias. 

Of additional interest are the coefficients located 
in column one (both tables) which show the correlations 
between student perception of home climate and the 
other sub and total scales. The home climate scale 
contains eight itemn and has a reliability of .81 at grade 
7 and .84 at grade 9. This scale is scored such that 
a higher value indicates the student is more satisfied 
v^th his/her relationship with parents and home 
conditions. 



Factor Analyses 

The interrelationships between the various total 
and subscales contained in the EQAI were further 
investigated by a factor analysis. At the outset principal 
components analyses were performed on the grade 7 
and 9 correlation data. Total scales which were 
composites of several subscales were excluded from 
consideration. These analyses were followed by varimax 
rotation. The various results of the seven factor solution 
for each grade level are presented in Tables 54 through 
57. Tables 54 and 55 present the correlations of each 
subscale to each of the seven factors. These correlations 
are called factor loadings. On these tables the highest 
factor loadings are highlighted by a box drawn around 
them. 

The columns in Table 56 labeled Per Cent of Trace 
show the proportion of total variability associated with 
all these subscales that can be accounted for by each 
of the seven factors. The seven factor solution can 
account for 60.2 per cent and 61.5 per cent of the 
total variance at grade 7 and 9. 

Great similarity exists between the grade 7 and 
grade 9 factor structure (Tables 54 and 55), thereby 
permitting a description of the results which apply to 
both grade levels. Factor I, accounting for 
approximately 13 per cent of the variance, appears to 
be composed of citizenship (Goal V) and health (Goal 
VI) subscales. The creativity (Goal VII) subscales load 
most highly on Factor 2 which accounts for about nine 
per cent of the variance. Factor 3 composition is that 
of self esteem (Goal I), accounting for about eight per 
cent of the variance. The understanding others (Goal 
II) subscales comprise Factor 4 which accounts for 
about 10 per cent of the variance. Factors 5 and 6 are 
reversed at the two grade levels. Note that Factor 5 
at grade 7 is essentially like Factor 6 at grade 9. In 
each case the highest loadings occur across goal 
instruments rather than within as in the other factors. 
Emotional adjustment (a Goal X subscale) and 
vocational attitude (the Goal VIll-A attitude scale) have 
the highest loadings for Factor 5 (grade 7) and Factor 
6 (grade 9). Factor 6 at grade 7 and Factor 5 at grade 
9 both reveal high loadings for Goals 111 (verbal 
s'lalogies and mathematical reasoning) and Goal VIll-K 
(knowledge). These factors are considered to reflect 
cognitive dimensions and account for about five per 
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cent of the variance. Factor 7, accounting for about 
eight per cent of the variance, is characterized by high 
loadings on the attitude toward school subscales (Goal 
IV) and appreciating human accomplishments subscales 
(Goal IX). 

The fact that the highest loadings generally 
occurred for the subscales witliin a goal area indicate 
that these subscales have liigher correlations among 
themselves than with subscales in other goal areas. 

Table 57 shows the amount of variance accounted 
for in each subscale by all seven factors. Note that only 
one-third of the variance associated with Uie social 
desirability scale can be-accounted for by these seven 
factors, indicating that this type of response bias is not 
a large factor in determining scores on the other EQAl 
scales. 

Summary of Factor Analyses 

The factor analyses were conducted to determine 
the ways that the individual scales in the EQAI cluslei 
with one another. Ideally, 10 factors should be found, 
each containing subscales in only one goal area. To yield 
these results each set of subscales designed to measure 
a particular goal area would relate more strongly to one 
another than to any other single subscale or set of 
subscales. It could then be concluded that each goal 
instrument was capable of giving unique information 
and further that each goal area reflected unique traits 
possessed by mdivi duals. 

The results of the factor analyses suggest that the 
above conclusions are not completely tenable. Several 
goal instruments do seem independent from other scales 
in the EQAI. These are s^ejf-^steem, tolerance toward 
others, and creativity. Yet other subscales cluster iicross 
goal areas rather than within goal areas. The subscales 
in the interest in school and appreciating human 
accomplishments instruments form one cluster. Another 
cluster is formed by the citizenship and health habits 
scales. The instruments comprising each of these '*across 
goal*' clusters have similar response formats suggesting 
that pan of this interdependence is due to the method 
used to measure these areas. 

The health and citizenship instruments have 
identical formats: persons are asked to put themselves 
in a make-believe student's place and decide >vhether 
to take ideal actions under a variety of 
motivation-inducing conditions. The motivating 
conditions presented in both instruments are also highly 
similar 



The interest in school and appreciating human 
accomplishments scales likewise have similar response 
formats. Each scale requires the respondent to respond 
on an agree-disai^ree continuum. In certain cases *Se 
items contained in '^ach of these scales are similar. For 
example, an item in Goal IV states **stuclying is a waste 
of time" and a Goal IX item says **reading novels is 
a waste of time, ' 

It should be noted at this point that the health 
and citizenship items as well as the interest in school 
and appreciation of human accomplishments items were 
subjected to another factor analysis prior to entry into 
the battery. ,These item analyses, as opposed to the 
aforementioned subscale analyses revealed that the 
citizenship items clustered independently from the 
health items and the interest in school items clustered 
independently from the appreciation of human 
accomplishments items. This independence can occur 
because of the difference in context-the item analyses 
compared items from two scales. The other factor 
analysis compared scores on subscales in the larger 
framework of the entire test battery of 26 subscales 
hence a given subscale had more opportunities to 
cluster. 

Another clustering of instruments in the EQAI 
occurs between the math and verbal achievement tests, 
the vocational knowledge test, and the social desirability 
scale. This cluster is a cognitive or knowledge 
component of the battery. The inclusion of the social 
desirability instrument in this cluster suggests that this 
scale might be more reflective of reading ability than 
the tendency to give favorable answers. A typical item 
in the social desirability scale is: '7 am always willing 
to admit when I have made a mistake." A student 
answering "very much like me" is given a high score 
on social desirability. However the choice of this 
response could simply result from the student glossing 
over the key word in the item which is always. 

Factor 5 of grade 7 and Factor 6 of grade 9 are 
the most complex clusters. These clusters contain 
subscales from five separate goal instruments. Those 
subscales that appear to be related in these factors 
include drugs, writing, vocational attitude, receiving and 
emotional adjustment. The negative factor loading 
associated with the Goal VIII-A (vocational attitude) 
scale suggests that students with more favorable 
vocational attitudes respond less favorably to the other 
four subscales. This relationship is consistent across 
grade levels and deserves further study. 



ERLC 



74 



In addition to identifying major clusters of 
instruments comprising Me EQAl, the factor analysis 
reveals several interesting relationships between some 
subscales and factors. The concern for welfare and 
dignity of others subscale contained in the citizenship 
instrument relates quite strongly with the tolerance 
tovmrd others c'.aster. The former scale taps student 
willingness to go to the aid of others in distress, to 
permit others into the group and to refrain from actions 
that might degrade another person. The subscales found 
in the tolerance toward others instrument measures the 
amount of comfort experienced by students when 
coming into contact with differing others. 



Another relationship of interest is that between the 
drug subscale contained in the health instrument and 
the cognitive cluster containing the math, verbal and 
vocational knowledge scales. This suggests that some 
students may be given undesirable answers to the drug 
items because they do not know that several of the 
listed practices are dangerous. Another hypothesis 
would be that "poorer "students have less desirable drug 
habits due to social conditions. This latter hypothesis 
seems less tenable in the light of the fact that the other 
two subscales contained in the health instrument (i.e. 
safety and personal health) do not relate to the 
cognitive cluster. 
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APPENDIX 



Measurement and Statistical Terms 



In this appendix we define the statistical terms and 
measurement concepts basic to the interpretation of the 
technical characteristics associated with each EQAI 
scale. 



Mean 

A mean score is the arithmetic average of a set 
of scores. The mean is computed by adding all of the 
scores and dividing by the sum by the number of scores. 

Standard Deviation 

This statistic gives information about the spread 
or dispersion among a group of scores. Typically about 
two-thirds of the scores wiU be found within one 
standard deviation above and below the mean and over 
99 per cent will be found within three standard 
deviations above or below the mean. 



Skewness 

This statistic gives information about the 
symmetry of a group of scores. This coefficient has both 
direction (plus or minus) and magnitude. If the 
distribution of scores is perfectly symmetrical such that 
for every score a certain distance above the mean there 
can be found a score which is the same distance below 
the mean the skewness coefficient will be 0.0. In a 
nonsymmetrical distribution which is negatively skewed 
there are more scores at the higher end of the 
distribution and fewer at the low end. The converse 
is true of positively skewed distributions. 

In reference to the skewness coefficients presented 
for each scale m Section Two, values ranging from -.1 1 
to +.11 indicate that the distribution is symmetrical. 
Values outside this range indicate the distribution is 
skewed in the direction of the coefficient's sign. 

Kurtosis 

This statistic indicates whether the score 
distribution is "flatter" or "more peaked" than a 
normal bell-shaped curve. Negativecoefficients show the 



distribution to be flatter than the normal curve while 
positive coefficients show the distribution to be more 
peaked. Kurtosis coefficients ranging between -.65 to 
+.65 indicate the distribution is essentially normal. 

Correlation 

This coefficient shows the degree and direction of 
linear association between paired variables. Correlation 
coefficients range from 0.00 to 1. 00 and can be plus 
or minus. A zero correlation means that scores on the 
first variable are not linearly related to scores on the 
second variable. A correlation of +1.00 or -1.00 are 
perfect correlations. Knowledge of scores from one 
variable give perfectly accurate information about the 
relative position of scores on the other variable. 

The sign of this coefficient shows the direction of 
the relationship. The correlation between height and 
weight is an example of a positive correlation - in 
general taller people weigh '^ore than shorter people. 
An example of a negative correlation is one between 
amount of formal education and tendency to be 
unemployed - in general the more education one has 
the less likely one will be unemployed. 

Readability Level: Gunning-Fog Index 

Because all EQAI scales are of the pencil-and-paper 
type it is important to insure that the vast majority 
of students have the necessary verbal skills to 
understand what is being asked. Altlv^ugh it is 
impossible to control the range of verbal achievement 
in a large testing program it is feasible to write scales 
that require minimum reading levels. Section One 
discussed the initial precautions taken to insure 
readability. After each scale was finalized, its readability 
level was estimated by the Gunning-Fog formula. This 
formula takes into consideration both the average 
number of sentences and the percentage of 
three-or-more syllable words contained in 100 words. 
The index derived from this formula is expressed in 
"grade level" terms. Thas if the index is 5.0 the scale 
should be understood by the average 5th grade student 
just entering 5th grade. 
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Reliability 

Reliability is that characteristic of a measuring 
instrument which deals with consistency of results - 
either over time (stability) or within the scale itself 
(internal consistency). Reliability coefficients are 
reported as two-place decimal figures ranging from .00 
to 1. 00. As the instrument increases in reliability the 
coefficient increases in value. 

Reliability coefficients can be interpreted as the 
proportion of the variance in a set of scores which is 
caused by variation in the examinee's true scores, rather 
than by errors of measurement. They can be estimated 
either from a single form of a test or from two parallel 
forms. When estimated using a single form of the test 
they are caUed internal consistency reliabilities. 

These coefficients were computed for all EQAI 
scales. The coefficients are derived by taking into 
account the length of the test and the extent to which 
test items contribute mutually confirming or consistent 
information. The KR-20 reliability formula was used for 
the knowledge scales socred on a **right vs. wrong" 
basis. For the attitude scales both the coefficient alpha 
and Guttman*s Lambda-3 were used to obtain internal 
consistency estimates. The latter is less affected by 
adverse factors such as negative inter-item correlations. 



Internal-consistency reliabilities based on 
criterion-referenced scoring of the scales were also 
obtained using Livingston's^ Formula. As the magnitude 
of these coefficients increases we can be more confident 
that errors of measurement are unlikely to make a 
difference between meeting or not meeting the criterion 
for many of the examinees. 



Standard Error of Measurement 

This statistic suggests a range within which an 
individual's true score would exist. One standard error 
of measurement on either side of the obtained score 
would suggest that two times out of three the 
individual's true score would fall within that range. As 
a rule of thumb, the standard error of measurement 
for the total score should not exceed 50 per cent of 
the magnitude of the standard deviation. 



Difficulty Level 

This term applies to tests which are scored on a 
right-wrong basis. The difficulty level of a test is 
expressed by the average per cent of the items answered 
correctly by the group taking the test. 
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